theporndatabase / stash_theporndb_scraper Goto Github PK

I believe that tpdb likely changed their api results format for scenes sometime this year when it comes to scene tags. When running scrapeScenes.py and a successful hit occurs, it fails to update the scene with the following error:

ERROR:root:Scrape succeeded, but update failed:
Traceback (most recent call last):
  File "/mnt/d/GIT/stash_theporndb_scraper/scrapeScenes.py", line 752, in updateSceneFromScrape
    tag_name = tag_dict['tag'].replace('-', ' ').replace('(', '').replace(')', '').strip().title()
KeyError: 'tag'

The tag results is a list of dictionaries under 'data.tags' in the json return, simplified example below:

[
  {
    "id": 2,
    "name": "Sex"
  },
  {
    "id": 29,
    "name": "Blowjob"
  }
]

If I comment out the portion for tagging, the update succeeds (without tags).
Any chance the scraper logic can be updated to account for this?
Thanks!

When I try to run scrapeScenes.py, it returns

  File "/Users/bradyjohnson/Downloads/stash_theporndb_scraper-master/scrapeScenes.py", line 16, in <module>
    import requests
ModuleNotFoundError: No module named 'requests'

Hy,
everytime i try to run the script I get the following error.

I'm on the development branch and the IP and port are correct.

INFO:root:API Key found for TPDB
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "GET /playground HTTP/1.1" 200 868
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "POST /graphql HTTP/1.1" 200 102
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "POST /graphql HTTP/1.1" 200 53
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "POST /graphql HTTP/1.1" 200 176
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "POST /graphql HTTP/1.1" 200 50
DEBUG:root:Getting tag id for tag 'ThePornDB Ambiguous'.
DEBUG:root:Found the tag. ID is 3
DEBUG:root:Getting tag id for tag 'Scraped From ThePornDB'.
DEBUG:root:Found the tag. ID is 4
DEBUG:root:Getting tag id for tag 'ThePornDB Unconfirmed Alias'.
DEBUG:root:Found the tag. ID is 5
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.22:9999
DEBUG:urllib3.connectionpool:http://192.168.0.22:9999 "POST /graphql HTTP/1.1" 200 50
ERROR:root:Something went wrong. Have you:
• Checked to make sure you're running the "development" branch of Stash, not "latest"?
• Checked that you can connect to Stash at the same IP and port listed in your configuration.py?
If you've check both of these, run the script again with the --debug flag. Then post the output of that in the Discord and hopefully someone can help.

Traceback (most recent call last):
File "/mnt/user/torrent/test/scrapeScenes.py", line 1185, in main
tag = my_stash.getTagByName(tag_name, False)
File "/mnt/user/torrent/test/StashInterface.py", line 620, in getTagByName
logging.debug("Getting tag id for tag '"+name+"'.")
TypeError: can only concatenate str (not "NoneType") to str

Any advice?
Thanks

I've pulled the latest update, ran the requirements.txt file.

When I run python3 scrapeScenes.py I'm getting the following error:

Traceback (most recent call last):
  File "/srv/dev-disk-by-label-data/users/alex/git/stash_theporndb_scraper/scrapeScenes.py", line 19, in <module>
    import StashInterface
  File "/srv/dev-disk-by-label-data/users/alex/git/stash_theporndb_scraper/StashInterface.py", line 8, in <module>
    import dateparser
ModuleNotFoundError: No module named 'dateparser'

Sites been down and API keys are not working

Hello,

We've tried to activate or update your repository on Depfu and couldn't find any supported dependency files. If we were to guess, we would say that this is not actually a project Depfu supports and has probably been activated by error.

Monorepos

Please note that Depfu currently only searches for your dependency files in the root folder. We do support monorepos and non-root files, but don't auto-detect them. If that's the case with this repo, please send us a quick email with the folder you want Depfu to work on and we'll set it up right away!

How to deactivate the project

• Go to the Settings page of either your own account or the organization you've used
• Go to "Installed Integrations"
• Click the "Configure" button on the Depfu integration
• Remove this repo (ThePornDatabase/stash_theporndb_scraper) from the list of accessible repos.

Please note that using the "All Repositories" setting doesn't make a lot of sense with Depfu.

If you think that this is a mistake

Please let us know by sending an email to [email protected].

This is an automated issue by Depfu. You're getting it because someone configured Depfu to automatically update dependencies on this project.