Herding Code 135: Remco Mulder and Jeff Schumacher on Continuous Testing

In this episode, the guys talk with Remco Mulder (author of NCrunch) and Jeff Schumacher (author of Giles) about continuous testing in .NET.

Download / Listen:

Herding Code 135: Remco Mulder and Jeff Schumacher on Continuous Testing [audio:http://herdingcode.com/wp-content/uploads/HerdingCode-0135-Continuous-Testing.mp3]

Show Notes:

  • Scott K kicks things off with a horrible old school BASIC joke.
  • Remco explains how NCrunch got started because he was living under a rock.
  • Jeff explains how Giles got started by finding AutoTest and seeing it not maintained (in reality it was).
  • Remco talks about the number of test frameworks.
  • Jon asks Remco about adding MSTest support – Remco groans about how difficult MSTest was to integrate with NCrunch.
  • Jeff mentions that xUnit’s test runner is complete for backward compatibility.
  • Jeff talks about Machine Specs and avoiding versioning hell with Impromptu Interface.
  • Jon asks about each library’s approach to Continuous Testing and to explain it to a laymen.
  • Rem explains what Continuous Testing is in relation to NCrunch.
  • Scott comments on a "strange situation" of testing compiled code creates slow tests and asks about any shortcuts Rem or Jeff have taken.
  • Jon comments how NCruch & Giles gives immediate feedback as he’s coding.
  • Jeff mentions that Giles has the ability to filter tests so that you only see what you want to see.
  • Remco explains how NCrunch attempts to determine impact to order how tests are run so the most pertinent tests run first.
  • Jon gives his quick history of the testing feedback cycle: separate project phase, then repository check-in step with continuous integration, local test runers, and now tests running as we write the code. Are we done? Where can we go from here?
  • Jeff comments about how Continuous Testing is like the red squiggly for code problems.
  • Scott asks about alternative language support for NCrunch and Giles.
  • Remco mentions that Salesforce.com has a Selenium "cluster" to continuously run UI tests.
  • Remco talks about Visual Studio integration for NCrunch.
  • Jeff talks about a branch that supports Mono.
  • Jon talks about Roslyn, and Scott K reminds us that Mono was doing compiler as a service long ago – 2008?
  • Remco jokes about clippy.
  • Jeff talks about Continuous testing and Pair Programming.
  • Jeff wanted to get to the point where he didn’t think about the tooling but only the tests and the code.
  • Jeff talks about Visual Studio magazine and an article about Continuous Testing.
  • Jon comments how easy NCrunch is able to setup and get going.
  • Remco wants to make Continuous testing really really easy to get people to start using it.
  • Jeff recommends looking at all the different continuous testing options, mentioning Greg Young’s Mighty Moose.

Show Links:

Show notes by Ben Dornis. Thanks!

  • markheath

    Great show. I have been using NCrunch for a while now and love it. Great to see lots of innovation in the continuous testing with .NET space. I made a very rudimentary autotest script for IronPython a couple of years ago, but never took the idea through to C#.

  • Richard Banks

    It’s a shame you recorded this when you did. A few weeks later and you could’ve asked about the vs11 beta and the new •run after build” feature for the unit test explorer as well as chutzpah for running qunit and jasmine in vs11. Great show regardless.