Git Product home page Git Product logo

apkcrawler's Introduction

APK Crawler

APK Crawler is a tool to automatically retrieve APKs from various internet sources

License

Take note that APKCrawler's GNU Affero General Public License v3.0 is strict concerning application service providers. If you use apkcrawler for a (web)service you need to open source your changes!

Usage

Fetch all Open GApps supported APKs from a given source

./report_sources.sh nosig | ./apkcrawler.py

or

./report_sources.sh nosig | ./apkbeastcrawler.py
./report_sources.sh nosig | ./apkdlcrawler.py
./report_sources.sh nosig | ./apkmirrorcrawler.py
./report_sources.sh nosig | ./apkpurecrawler.py
./report_sources.sh nosig | ./aptoidecrawler.py
./report_sources.sh nosig | ./mobogeniecrawler.py
./report_sources.sh nosig | ./playstorecrawler.py
./report_sources.sh nosig | ./plazzacrawler.py
./report_sources.sh nosig | ./uptodowncrawler.py

Inline

APK Crawlers emits the downloaded filename(s) so it can be used inline with Open GApps' add_sourceapp.sh

./add_sourceapp.sh $(./apkcrawler.py        report.txt)

or

./add_sourceapp.sh $(./apkbeastcrawler.py   report.txt)
./add_sourceapp.sh $(./apkdlcrawler.py      report.txt)
./add_sourceapp.sh $(./apkmirrorcrawler.py  report.txt)
./add_sourceapp.sh $(./apkpurecrawler.py    report.txt)
./add_sourceapp.sh $(./aptoidecrawler.py    report.txt)
./add_sourceapp.sh $(./mobogeniecrawler.py  report.txt)
./add_sourceapp.sh $(./playstorecrawler.py  report.txt)
./add_sourceapp.sh $(./plazzacrawler.py     report.txt)
./add_sourceapp.sh $(./uptodowncrawler.py   report.txt)

Supported Sites

Requirements

Installation

You can use mfonville's protobuf PPA for python3-protobuf

sudo apt install python3-bs4 python3-html5lib python3-protobuf python3-requests python3-tz

or

pip3 install beautifulsoup4 html5lib protobuf requests pytz

Known Issues

  • There needs to be a way to grab an older version of an application as the current version (e.g. Current WebView on APK Mirror is the beta version)

apkcrawler's People

Contributors

bgiesing avatar mfonville avatar nicholasbuse avatar therealssj avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.