There are NOT a lot of free resources available on the Internet for A/B Testing. This post tries to lists the best tools, guides and resources for A/B Testing. As it will be an ever growing list, feel free to make suggestions for additions into the list.

Tools

• Visual Website Optimizer – Our own hassle-free visual A/B, split and multivariate testing tool. Use invite code “wingify-blog” (without quotes) for a free account.
• Google Web Optimizer – From the land of Google, comes a simple but free to use A/B and Multivariate testing tool
• Five Second Test – Ultra simple A/B testing for images
• A/Bingo – A Ruby on Rails plugin for doing A/B tests
• Vanity – Experiment driven development framework for Rails
• Genetify – An open source JavaScript based framework for A/B testing
• DIY A/B Split Testing using PHP and MySQL – a very simple and short tutorial (with code)
• A/B Testing with CakePHP and JQuery – a plugin for CakePHP framework
• Django-lean – a split testing framework for Django

Guides

• Effective A/B Testing – a superbly made presentation cum tutorial on A/B Testing
• 101 Tips for Google Website Optimizer – a long list of tips, tricks and ideas on how to use GWO
• Microsoft’s Practical Guide to Controlled Experiments on the Web [PDF] – an excellent paper on how testing should be done
• Technical overview of How Google Website Optimizer Works
• From 20 Bit’s blog
  • An Introduction to A/B Testing
  • Implementing A/B Testing
  • Statistics for A/B Testing

Show case of existing A/B Tests

• Anne Holland’s Which Test Won
• ABTests.com

If you have any other suggestions for additions in the list, I will be happy to add them. Just leave a comment.

Posted in Conversion Optimization, Split and Multivariate Testing on November 5th, 2009 | 15 Comments »

Holidays are near. I hear you say: yay! Holidays have always been a very happy period for marketers, businesses and customers alike. Businesses want to cheerfully sell stuff and customers want to gladly buy stuff. What a perfect setting!

Even though eCommerce sales and conversions generally increase in this season, they can be optimized even more. If you are looking for ideas to increase conversion rate specifically for holiday season, the following list will serve exact that purpose. How to optimize ecommerce conversions for holidays? Here’s how:

1. Split test a holiday themed website – too afraid to overhaul the website for holidays? Split test by including a fraction of visitors and see if it increases conversions. As our past experience says, it should.
2. Target visitors from other countries with the non-holiday themed website - even if you theme your website, don’t loose visitors from countries other than where holiday season is on. Visitors come to your website from all parts of the world; some of them will be from regions/countries where they don’t have this holiday season. Don’t confuse them, just serve them with a different website template.
3. Segment the visitors on week of the day and time of the day – during holidays, clear patterns in different types of visitors emerge because their is frantic online shopping. See how buying behavior changes with the time or day; leverage that information to better target your offers and achieve even more conversions
4. Split test gifts v/s direct purchases – in holiday season, having calls to action which let visitors gift items instead of purchasing may indeed increase total revenues
5. Send targeted holiday offers through email based on visitor profile – segment your previous customers on city, country, past purchases, kids and other parameters and send targeted offers to them
6. Leverage holiday sentiment effectively – for example, a perfect ad copy that plays on holiday sentiments: What are you gifting your child this Christmas? In last two hours, 52 moms already gifted this super-fast toy-car for their kids this holiday season.
7. Create a sense of hurry – have offers like ‘Flat 25% discount only till Christmas. Buy Now!‘, or ‘Buy at old price. Prices increasing 30% in the New Year’

Use all of the above ideas for increase sales for your business but keep a general tip in mind: run lots of split tests to test different ideas but at a time include only 10-15% of all website visitors because you wouldn’t want too many lost sales opportunities if different versions/ideas perform poorly. But, of course, this depends on the total traffic. If you are a small e-Commerce store, you may not have luxury to get test results with just 10-15% of visitors.

What are your favorite strategies for holiday-specific conversion optimization? Tried any of the strategies described here? Would love to hear your experiences and viewpoints.

Posted in Conversion Optimization, Split and Multivariate Testing on October 30th, 2009 | 2 Comments »

To get started with conversion rate optimization, first let us agree to what conversion rate really is. Simply put, the conversion rate of a website is the percentage of visitors or visits that result in completion of a conversion event. Conversion event is a very broad term and it totally depends on the (business) goals of a website; it may be user registration, purchase, whitepaper download or free trial, etc. Obviously, a business desires that more number of visitors (ideally all) complete the conversion process.

Conversion rate optimization is a huge discipline in itself as there are numerous methods for increasing the conversion rate of a website. However, if you are just getting started to get serious about squeezing the maximum out of your traffic, following are three basic yet super-effective tips:

1) Test your “Call to Action”:

Your “Call to Action” is the main button or link that persuades the visitor to start the conversion process. Call to action can be your registration or checkout button. Needless to say it is the most important part of the conversion process. Your call to action should be the most prominent part on the page and should excite the visitor to start the conversion process. Different elements should be tested in order to see what works best. Try varying message, size, font and colour of the button or link. A quick tip: it is always best to avoid using texts that are vague and don’t convey any meaning. For example, commonly used examples of less effective call to action are “click here”, “submit”, “read more,” etc. Are you using such buttons or links on your website? Change them immediately. Instead, you should use more descriptive and persuasive text that tells your visitors where they are going and why they should go there. This will then drive your visitors to take the desired actions. Placements of the call to action is also important and it is recommended that this be above the fold and be near points of attention.

To repeat: “Click Here” is bad; while “Free, no obligations Download” is good.

Ideally, you should setup a split test for testing different variations of your button or link. However, to begin with you can tweak your call to action so as to make it most prominent element on the page. A person standing 15 feet away from the screen should be able to recognize your call to action.

2) Simplify your conversion funnel:

The conversion funnel is a set of pages (like the checkout process or registration form) that leads to your conversion goal (like a product purchase or subscription). Most web analytics tools (including some free ones) can be configured to allow you to visualize where your visitors are leaking from your conversion funnel. You may be surprised to know that most visitors abandon step 2 of your conversion funnel because you are asking for their personal details when they are not motivated enough by step 1 to warrant that. A complicated conversion funnel needs to be simplified in order to push the traffic through to the final conversion page. A few tweaks to simplify your funnel thereby increase your conversion rate:

• Remove all extraneous links from pages within the conversion funnel
• Remove all unnecessary steps from the conversion funnel
• Don’t put too much focus on up-selling other offers
• Only ask for information that is completely necessary in completing the conversion process. Visitors are hesitant to reveal their information if it unjustified
• In the case of shopping carts, clearly let the visitor know about postage and packaging costs, taxes and your returns policy as early in the process as possible
• And make sure that you remind your visitor what they’ve added to their cart by placing a link back to the product

3) Don’t let your visitors doubt your business trustworthiness

No matter how persuasive your call to action is or how simple your website is, if you do not give the impression of trustworthiness to your visitors or give them confidence in your website, you are not very likely to improve your website’s conversion rate. Your visitors need to know that you are not fly-by-night operation and you are here to remain. There are different methods which you can apply on the website pages to increase visitors’ confidence in your website and products. These include:

• Assuring your visitors that you value their privacy and that you have a secured site. This can go a long way to instil confidence in any interactions that visitors have with your website. This can be done by adding HackerSafe (or similar) badges that show that you take the issue of website security seriously
• Having a professional looking and uniform layout throughout your website will give the impression that your website is well designed and professionally maintained. This would include having consistent placements of navigation buttons and branding throughout the website
• Displaying your privacy policy wherever you ask personal information from the visitor

Those were simple yet extremely effective tips which many businesses fail to consider. Many a times, the conversion rate is sub-optimal and business owners aren’t even aware of that. They are too happy with their single percentage point conversion rates. But now that you know there are tons of tweaks that you can do which will directly impact your website sales and revenues, you should better get started now!

How is your experience with these tips? Tried them on your website? Do share with us your story.

Posted in Conversion Optimization, Split and Multivariate Testing on October 25th, 2009 | 2 Comments »