I will be examing an A/B Testing Experiment in this repository and going through all the standard analyses.
Author: CHENG CHEN
LinkedIn: https://www.linkedin.com/in/chengchen-jimmy
Date: 06/30/2018
This is a A/B testing tutorial. I will go through a basic A/B testing problem in the e-commerce field. The data comes from BitTiger. Please indicate the source if sharing.
If you would like to give any suggestions or correct some fields, I could be reached at cheng.chen.2017@marshall.usc.edu. It will be very helpful! Thanks beforehand!
This data shows user's activities on a online sales website.
An experiment was launched on day 4 with a goal to increase users' click through rate (clicks/views) and total revenue.
Note: first 3 days no experiment, 4th-14th days experiment running
Analyze the data and write a report to answer the following questions:
-
Is the experiment correct? Please note any problems in your report.
-
Did the test version help increase CTR and total revenue? Help the team make the right decisions.
-
There might be learning effect for users to get used to the change. Help the team understand this.