There are NOT a lot of free resources available on the Internet for A/B Testing. This post tries to lists the best tools, guides and resources for A/B Testing. As it will be an ever growing list, feel free to make suggestions for additions into the list.

Tools

• Visual Website Optimizer – Our own hassle-free visual A/B, split and multivariate testing tool. Use invite code “wingify-blog” (without quotes) for a free account.
• Google Web Optimizer – From the land of Google, comes a simple but free to use A/B and Multivariate testing tool
• Five Second Test – Ultra simple A/B testing for images
• A/Bingo – A Ruby on Rails plugin for doing A/B tests
• Vanity – Experiment driven development framework for Rails
• Genetify – An open source JavaScript based framework for A/B testing
• DIY A/B Split Testing using PHP and MySQL – a very simple and short tutorial (with code)
• A/B Testing with CakePHP and JQuery – a plugin for CakePHP framework
• Django-lean – a split testing framework for Django

Guides

• Effective A/B Testing – a superbly made presentation cum tutorial on A/B Testing
• 101 Tips for Google Website Optimizer – a long list of tips, tricks and ideas on how to use GWO
• Microsoft’s Practical Guide to Controlled Experiments on the Web [PDF] – an excellent paper on how testing should be done
• Technical overview of How Google Website Optimizer Works
• From 20 Bit’s blog
  • An Introduction to A/B Testing
  • Implementing A/B Testing
  • Statistics for A/B Testing

Show case of existing A/B Tests

• Anne Holland’s Which Test Won
• ABTests.com

If you have any other suggestions for additions in the list, I will be happy to add them. Just leave a comment.

Related posts:

1. 10+ Free Resources for Creating High Converting Call-to-Action Buttons
2. Introducing Visual Website Optimizer – 50 free beta invites
3. Seven actionable ideas to optimize e-Commerce website conversions for the holiday season
4. Three effective tips to get started with conversion rate optimization
5. Your swiss-army knife for increasing website sales and conversions

Posted in Conversion Optimization, Split and Multivariate Testing on November 5th, 2009 | 15 Comments »

15 Comments »

1. May I also suggest django-lean? http://bitbucket.org/akoha/django-lean/wiki/Home

   Comment by Dominic Jodoin — November 5, 2009 @ 11:44 pm

2. What about http://mixpanel.com ?

   Comment by Richard — November 6, 2009 @ 12:27 am

3. You can add the split tester calculator:
   http://abtester.com/calculator/

   it is also providing the full PHP implementation of the maths behind the confidence calculations etc.

   Comment by Loïc d'Anterroches — November 6, 2009 @ 2:10 am

4. [...] 15+ Free A/B Split Testing Resources « Wingify Conversion Optimization Blog [...]

   Pingback by 15+ Free A/B Split Testing Resources « Wingify Conversion Optimization Blog — Some Random Dude — November 6, 2009 @ 6:40 am

5. @Richard – If I am not wrong, MixPanel does not provide A/B testing functionality out of the box. Correct me if I am wrong and I will be happy to add it in the list

   @Loïc Thanks for the suggestion but there are a lot of calculators on the net for A/B Testing; this list collects tools which allow you to do A/B testing

   Comment by Wingify — November 6, 2009 @ 9:51 am

6. Nice, I have many attorneys and clients asking about A/B testing so I can now just forward them this post. Getting them to try new stuff like this is like pulling teeth sometimes.

   Comment by Marc — November 6, 2009 @ 8:12 pm

7. [...] Template Designer CheatSheet A Round-Up of Useful Web Apps for Web Designers 15+ Free A/B Split Testing Resources20 Very Useful CSS Stylesheet Tips & TricksQuickie CSS3 Tricks with FallbacksThe Analysis of [...]

   Pingback by Brainboom 45/09 – 18 great web design links for your weekend | Sharebrain » — November 6, 2009 @ 10:14 pm

8. Great list. Thank you for including my tutorial as well. I appreciate it very much.

   Comment by Tony Legrone — November 9, 2009 @ 10:56 pm

9. A very useful resource in the making here guys! Based on our experience of running 1000s of tests over the years, we put together the article above; “Top 3 Most Profitable Pages for Multivariate Testing”.

   Each point is illustrated with a real-wold client success story. Hopefully it will be of interest to some of your readership who might be wondering where to start with their testing strategies!

   Comment by Alasdair Bailey — November 11, 2009 @ 10:48 pm

10. Okay, it only linked my name, here’s the URL:

    http://www.maxymiser.com/3_Most_Profitable_Pages.htm

    Comment by Alasdair Bailey — November 11, 2009 @ 10:48 pm

11. [...] 15+ Free A/B Split Testing Resources « Wingify Conversion … [...]

    Pingback by ad2action – An Affiliate Marketer’s Dream | Ad2Local.Com — November 12, 2009 @ 8:21 am

12. [...] Shared 15+ Free A/B Split Testing Resources « Wingify Conversion Optimization Blog. [...]

    Pingback by The Bliss of Being › Waynes Weekly Notable Links — November 13, 2009 @ 7:16 am

13. [...] 15+ Free A/B testing resources Share: [...]

    Pingback by Weekend Reading #3 — November 23, 2009 @ 6:23 am

14. [...] Готовая подборка хороших ссылок по этой теме: 15+ Free A/B Split Testing [...]

    Pingback by Интересные ссылки №200 - max - блог разработчиков — January 15, 2010 @ 5:15 pm

15. [...] 15+ Free A/B Split Testing Resources There’s a good round-up of free resources available on the Internet for A/B testing on this Wingify blog post.  Definitely worth a read.  If you like the post, browse the other blog entries on Wingify… They’re all about testing. [...]

    Pingback by Three reasons not to A/B/Multivariate test — February 24, 2010 @ 9:52 pm

RSS feed for comments on this post. TrackBack URL

Leave a comment