Git Product home page Git Product logo

communityscrapers's Introduction

CommunityScrapers

This is a public repository containing scrapers created by the Stash Community.

To download the scrapers you can clone the git repo or download directly any of the scrapers.

When downloading directly click at the scraper.yml you want and then make sure to click the raw button:

and then save page as file from the browser to preserve the correct format for the yml file.

Any scraper file has to be stored in the ~/.stash/scrapers ( ~/.stash is where the config and database file are located) directory. If the scrapers directory is not there it needs to be created.

After updating the scrapers directory contents or editing a scraper file a restart of stash is needed and a refresh of the edit scene/performer page.(In recent stash builds instead of restarting scrape with -> reload scrapers is enough)

Scene Scrapers

You can find a list of sites currently supported for by community scene scraping in SCENE-SCRAPERS.md

For scene scrapers you have to edit the url of the scene. Once you populate that field with a specific url a button will appear.

Clicking on that button will populate any empty fields with data found from the scraper. The only exception is the scene cover image that always gets updated from the scraper.

Performer Scrapers

This list is meant to keep track of which sites are already supported by existing community scrapers. And which scrapers support them. When introducing a new scraper, add the sites your scraper supports to this list in your PR. Please keep the site list in alphabetical order to keep the list tidy.

Supported Site Scraper
babepedia.com Babepedia.yml
freeones.xxx FreeonesCommunity.yml
iafd.com Iafd.yml
manyvids.com ManyVids.yml
pornhub.com Pornhub.yml
sexvr.com SexVR.yml

Contributing

Contributions are always welcome! Use the Scraping Configuration wiki entry to get started and stop by the Discord #the-scraping-initiative channel with any questions.

communityscrapers's People

Contributors

mmenanno avatar bnkai avatar mrx292 avatar belleyy avatar niemands avatar peolic avatar whitty-username avatar benni-chan avatar leopere avatar wannabestraight avatar bikkmakk86 avatar compound-dumbo avatar hyde231 avatar

Stargazers

Anne Thorpe avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.