A/B Testing – Interview Questions

What do you understand by A/B Testing? What is the goal behind performing A/B Testing?

What do you understand by data sampling in A/B Testing?

What is the use of Confidence interval in A/B Testing?

When should you think of performing A/B testing?

What's multivariate testing, and how does it compare to A/B testing?

How many variables should I test?

Name few of the variations that can be applied to a web page?

Explain the step by step process for A/B Testing.

What are the common type of tools that can be used to collect data for A/B Testing?

What is the purpose of using Replay tools? Name a few Replay tools for A/B Testing.

Why do we use Survey tools? Give an example of a survey to collect data.

Give a few examples of generating hypothesis in A/B Testing?

What do you understand by creating variations in A/B Testing? What are the common tools that can be used for this?

What is WYSIWYG editor in VWO? How do you create variations using that?

What are the other type of testing that can be performed using VWO?

Where else can you use A/B Tests on things other than web pages?

What do you understand by A/B Testing - Analyze Results?

How do you integrate Google Analytics with Optimizely?

What is the difference between Universal GA and Classic Google Analytics?

Does A/B Testing negatively affect SEO? Explain different ways that ensures to run A/B Tests without worrying about losing the potential SEO Value?