Git Product home page Git Product logo

ab-test-project's Introduction

ab-test-project

WNW streaming A/B testing project from my Applied Analytics subject at university.
The final report can be viewed via https://carimo198.github.io/ab-test-project/

Background

WNW is a streaming company which is refining their recommendation engine to provide better recommendation to customers.
Better recommendations improve user engagement and importantly increase the average hours watched per user per day, a key metric used to price ads for 3rd party marketing companies.

The executives at WNW want to know if the new recommendation engine algorithm is worth rolling out to all their subscribers. They have asked you to analyse the results from a recent change they made in their recommendation engine and present the results to the executive team.

The sample data

The executives are also interested in any other insights you may learn from the sample data (available to download on my ab-test-project repository). In particular, they are curious about the following:

  • Is there any bias in the data collection?
  • How could any bias be corrected?
  • What improvements could be made to future A/B tests?

The sample data shows the effect of an A/B test conducted to measure the effectiveness of a change to the recommendation engine used on some subscribers, but not others. The change to the recommendation went live at 1-minute past midnight on the 18th of July.
Those customers who were unknowingly using the new recommendation engine to suggest what to watch next are labelled as group B, while group A was used as a control group.

The data set has the following fields:

  • date in format dd/mm
  • gender of the customer
  • age of the customer
  • social metric, which is a combined metric based on previous viewing habits
  • number of months since the customer signed up
  • demographic number
  • group (A/B) where A is the control and B is the treated group
  • number of hours watched in that day

The streaming_data.csv contains the dataset.
The complete code for the project is available via the ab_testing_project.Rmd file.
The final report can be viewed via https://carimo198.github.io/ab-test-project/

ab-test-project's People

Contributors

carimo198 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.