Git Product home page Git Product logo

analyze_ab_test_results's Introduction

Analyze A/B Test Results Using Python

This project was completed as part of Udacity's Data Analyst Nanodegree Program certification in December 2020.

Summary

The statistical analysis performed helps to understand the results of an A/B test run by an e-commerce website. This project is aimed at helping the company understand whether they should implement the new page, keep the old page, or perhaps run the experiment longer to make their decision. Two statistical techniques were used to achive results. A/B Testing and Regression approach. The datasets for this project, were provided by Udacity as part of the Data Analsis Nanodegree Program.

A/B Testing Approach

  • Start A/B testing by making a claim (setting up hypothesis testing)
  • Simulate the values of the statistic that are possible from the null by bootstrapping sampling distributions and p-value calculations
  • Make a decision based on the likelihood the data came from the null hypothesis considering the type I error threshold
  • Performing z-test

Logistic Regression Approach

  • Statsmodels used to fit the regression model specified to see if there is a significant difference in conversion based on which page a customer received
  • Assessment of how well the model is performing using a variety of metrics, like countries the users are from and the interactions among variables

Technologies Used

  • Python, Numpy, Pandas, Matplotlib, proportions_ztest, StatsModels
  • LaTex
  • Jupyter Notebook

Results

  • There is not sufficient evidence to predict that the new page results in more conversions than the old page.
  • There is not enough evidence to suggest that country of the user has an effect on the conversion rate.

Resources

analyze_ab_test_results's People

Contributors

f-zarian avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.