How much you need to spend on a/b testing to validate the landing page conversion rate increase

[burningbright307]

A lot of people who want to ab-test landing pages underestimate how much money they need to invest in traffic for validation. Few additions:

1. If your testing budget is less than $2000 most of the time you can't afford testing small changes. Whatever your hypothesis is it must increase the conversion rate by 20%+
2. If the conversion rate of your control landing page is less than 10%, you need significantly more money to validate even very promiseable hypothesis

Created an infographic with a few examples for Facebook (Instagram) ads. Test budget estimates are made for an average CPC of $0.8, confidence interval is 95%.

Hope its helpful.

https://preview.redd.it/yvnxq866mvh...bp&s=4b996e4d391663385adc5a14b309baef0dd6e973