Multivariate testing for complex scenarios
Have millions of visitors every month and complex testing ideas? Then multivariate testing is the go-to method for you. Multivariate testing lets you combine groups of variations and evaluate which combination of changes works the best.
Multivariate testing gives you immense power to discover which combination of changes works best together. Notice that you will need hundreds of conversions or more for each combination to gain statistical significance. This means if you want to to a meaningful multivariate test you will need millions of visitors and tens of thousands conversions to get reliable results.
A good example of a multivariate test is if you want to try 3 different "CTA" copies on a buy button. You also want to test 3 different colors of the button and 3 different sizes. This means you will get 3*3*3 (27) variations in this case.
After you multivariate test has run SiteGainer will calculate the statistical significance for each combination and give you reliable data to act on.
Follow these 4 steps to create a multivariate test:
Setup the test. Define which visitors should experience the test and which URLs that will be included.
Track on-page analytics. SiteGainer tracks the actions users take on your site; for example, which links they click, how long they stay on the site, which URL's they visit, how many of them opt-in to an email form, etc.
Analyze the results. Once you have the data on how your combined variations performed, you analyze the result and determine which variation should be implemented permanently.
Why Multivariate test?
- All benefits from A/B testing plus...
- Discover the best combination of changes in complex scenarios
- Decrease production time of complex tests
What can you Multivariate test?
- USP lists
- Call to actions
- Contact details
- Shipping details
- Picture sizes
- Hover effects
- Sticky / non sticky
- Steps in checkout
- Header content
- Above the fold content
- Fly to cart
- Payment methods
- Responsive design
- Mobile layout
- Text size
- And lots more!