• http://www.rimmkaufman.com George Michie

    Shiver me timbers, that’s a fine piece, lad!

  • http://ConversionScientist.com Brian Massey

    Thanks, George.

  • http://www.findmefaster.com Matt Van Wagner

    Who knew reading about testing could be so much fun!

    Thank you for providing a document to help folks develop a good process for test planning and evaluation.

    One suggestion, I’d make for your test document. A free-form section called ‘observations,’ to encourage people to make freeform notes about their experiment, too. I’ve found that it’s the notes that help us build better tests next time around – things we discover that we could have or should have done differently, biases and events we did not expect, and ideas for follow on experiments. We get lots of great ideas this way – and learn about out testing environment in the process.

  • http://ConversionScientist.com Brian Massey

    Matt, your points are good. The tests are only as good as our ability to begin understanding “Why.” Free form speculation is important, if only to create our next hypothesis. I usually do this in the “Recommendations” section. Maybe I’ll add a “Riffs” section too.