Tech Track: Beautiful A/B Testing

Successful SaaS companies like Prezi perform hundreds of A/B tests. Building out our in-house system for tracking experiments, we learned that A/B testing has much depth and beauty than simply computing statistical significance from conversation rates. Topics covered in the talk include:

– how to A/B test against internal company KPIs like Prezi Views

– pitfalls of A/B testing such as peaking

– how to use Bayesian inference in A/B testing