A/B Testing

NOTE: This file has some general information. Please read the Mac/Windows specific readme file for specific instructions.

Overview

A/B testing is a user research technique, which is used to test which among the A or B version is better design.

For a commercial marketplace the success metric could be calculated based on "conversion rate".

What does this project do?

This project does simple A/B testing, of 2 versions of a website. The metrics collected could then be used to see which version among the baseline(A) or variant(B) performed better.

Running the flask server

These steps are used for running and testing locally.

Running and testing it locally.

Following command to be run on Mac OS terminal or WINDOWS powershell.

pip install -r requirements.txt python app.py

Sample Output while testing locally:

Creates output file of the following format.

Aarthis-iMac:a-b-testing aarthi$ cat ab_test.csv version,pageLoadTime,clickTime,clickHTMLElementId,UniqueSessionID B,1506176905681,1506176908590,ca1,1506176905390 B,1506176905681,1506176909309,ca2,1506176905390 A,1506176912336,1506176914382,mp2,1506176912222

Sample output after hosting in heroku.

2017-09-22T04:15:05.318219+00:00 app[web.1]: AB_TESTING: A 1506053696735 1506053705304 mp1 1506053696475 2017-09-22T04:15:07.288130+00:00 app[web.1]: AB_TESTING: A 1506053696735 1506053707279 mp2 1506053696475 2017-09-22T04:15:08.353015+00:00 app[web.1]: AB_TESTING: A 1506053696735 1506053708343 mp2 1506053696475 2017-09-22T04:15:09.444328+00:00 app[web.1]: AB_TESTING: A 1506053696735 1506053709431 mp1 1506053696475 2017-09-22T04:15:14.822574+00:00 app[web.1]: AB_TESTING: B 1506053712624 1506053714784 ca1 1506053712526 2017-09-22T04:15:16.682459+00:00 app[web.1]: AB_TESTING: B 1506053712624 1506053716671 ca2 1506053712526 2017-09-22T04:15:17.769221+00:00 app[web.1]: AB_TESTING: B 1506053712624 1506053717759 ca1 1506053712526