Git Product home page Git Product logo

falla's Introduction

FAllA

A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...
NOTE: For educationnal purpose, am not responsible of the bad use of this tool !

Requirements

  • Python (3.x)
  • Docker-CE (Not required for all search-engine, just few of them)

How to install

  • You need to install all requirements :
pip3 install -r requirements.txt
  • Install geckodriver :
# For linux users
sudo apt install firefox-geckodriver

# For other OS's users, please check releases on https://github.com/mozilla/geckodriver/releases
  • Pull and run the splash-scrap module from docker-hub (Some of search engine need this):
docker run -p 8050:8050 scrapinghub/splash
  • Replace example.config.txt by config.txt and provide the running IP for the splash-scrap

How to launch

How to use Falla:

usage: main.py [-h] [-e ENGINE] [-q QUERY]

optional arguments:
  -h, --help            show this help message and exit
  -e ENGINE, --engine ENGINE
                        The search engine
  -q QUERY, --query QUERY
                        The query text
  • To list all search-engine:
$ python3 -m app.main
# output
[+] Falla [the search-engine-scraper]
[+] Listing search-Engines
[+] > google
[+] > bing
[+] > aol
[+] > dogpile
[+] > falla
[+] > ask
[+] > qwant
[+] > duckduckgo
[+] > mojeek
[+] > gibiru
[+] > yandex
[+] > yahoo
[+] > searchencrypt
[+] > iem
[+] > kallasearch
[+] > wosx
  • To search something:
$ python3 -m app.main -e google -q "sanix darker"
# output

## Author
  • Sanix-darker

falla's People

Contributors

dependabot[bot] avatar sanix-darker avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

falla's Issues

Any possibilities to disable some search engine

i've pulled this but actually Docker doesn't work on my machine right now, and it seem like some search engine does not require it to work. Like a plugin system, allowing to disable the one requiring Docker to work.

Selemium problem

Having this issue when running the command from the example.
selenium.common.exceptions.WebDriverException: Message: invalid argument: can't kill an exited process
Capture d’écran 2020-04-29 à 09 02 50

I am on MacBook Pro (Mac OS Mojave)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.