GooglePlayCrawler

A python script to batch download mobile apps from Google Play Store. It supports batch downloading by collection/categorie (default to Top Free 120) as well as recording the information (such as downloads/version/size/ratings/supported Android version etc.) of downloaded APKs in a csv files.

Getting Started

Prerequisites

This project depends on a couple of unofficial Google Play APIs, and here is their installation instruction:

google-play-scraper : Node.js module to scrape application data from the Google Play store.

npm install google-play-scraper

google-play-api : Turns google-play-scraper into a RESTful API.

"download the repo using the link above"
cd {download folder}
npm install

gplaycli : Google Play Downloader via Command line

pip3 install gplaycli

Setup

Please make sure the config file for gplaycli is set correctly, and other prerequisites are working properly.

Change the GSCRAPPER_DIR in gpcconstants.py file to the folder where google-play-api is installed.

Google constantly checks the accounts activity and blocks the api access. To avoid the authentication error, it is recommended to set up two factor login and an app password, then use the app password to login.

Usage

python GooglePlayCrawler.py -d DIR (-a [ALL] -c [COLLECTION] -g [CATEGORY] -n [NUMBER] -s [START])

Available Options

  -h, --help            show this help message and exit
  -d DIR, --dir DIR     The folder to store the downloaded APKs (required)
  -f [FORCE_OVERWRITE], --force_overwrite [FORCE_OVERWRITE]
                        Option to overwrite the existing APKs in the
                        directiory (default: diabled)
  -a [ALL], --all [ALL]
                        Set this option to True will download all categories
                        (default: False)
  -c [COLLECTION], --collection [COLLECTION]
                        The collection to download from
                        {TOP_FREE,NEW_FREE,GROSSING,TRENDING} (default:
                        TOP_FREE)
  -g [CATEGORY], --category [CATEGORY]
                        The category to download (default: NONE; Available
                        options can be found in documentation).
  -n [NUMBER], --number [NUMBER]
                        The number of apps to download (default: 120; Max:
                        120).
  -s [START], --start [START]
                        The starting index of the retrieved list (default: 0;
                        Max: 500)
  -dc [DEVICE_CODE], --device_code [DEVICE_CODE]
                        The target device of the download apps (default:
                        hammerhead)

Example Usages

Check the available options:

python GooglePlayCrawler.py -h

Download the top 100 free apps from Google Play:

python GooglePlayCrawler.py -d DIR -n 100

Download the top 100 free apps from ANDROID_WEAR category (overwriting the existing APKs):

python GooglePlayCrawler.py -d DIR -g ANDROID_WEAR -n 100 -f

Download the top 50th to 100th new apps from SOCIAL category for Nexus5X:

python GooglePlayCrawler.py -d DIR -g SOCIAL -n 50 -s 50 - dc bullhead

Authors

Duling Lai - Single Contributor - DulingLai

License

This project is licensed under the MIT License - see the LICENSE.md file for details

sajidrahman / googleplaycrawler Goto Github PK