Git Product home page Git Product logo

nn-downloader's Introduction

NN-Downloader

Welcome to the successor of the multporn image downloader v1 & v2 and most downloaders out there regarding "NSFW" material. The NN-Downloader or Naughty-Naughty-Downloader (yes very creative I know) supports multiple sites with their official API (if available), and proxies and it's also portable.

Preview

preview

Note

This projects windows exe is built using Github Actions for full transparency on the build process.

Windows Download | Linux Download (Thanks to incognibro538)


Features:

  • Portable
  • Proxy Support
  • AI Training Compatible
  • Avoid Duplicates
  • Fast & Efficient Downloads

Currently Supported:


Further sites can be added. Just open a support ticket with the URL to the site.



Disclaimer

I am not in any way affiliated or working with these Sites. This is an unofficial project.
*I would suggest you use a customized Terminal.

nn-downloader's People

Contributors

dependabot[bot] avatar incognibro538 avatar official-husko avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

nn-downloader's Issues

[BUG] Folder Name Length causing crash

The Bug
If you run the Downloader with tags longer than 256 char it breaks as the output folder name cant be longer then that.

Error
[WinError 123] The filename, directory name, or volume label syntax is incorrect: 'media/22-06-2024_12-52-58_-vore_-death_-flash_-fart_-nipple_vore_-breast_expansion_-vore_pov_-unbirthing_-pooping_-body_size_growth_-urine_-soiling_-muscular_-big_breasts_-big_penis_-thick_thighs_de4dm1lk_fleurfurr_lettuce_artist_kind_lurker_ssevisx_81yffulfmm_noxxlss_ruffruffles_lintwave_4hazelstreet_uricomics_dudles_codyblue-731_100racs_replicant_skrunkle_lemonbird_rilesthecat_entom_kyufuru_lyonley_slashkill_domibun_lilmoonie'

To Reproduce

  1. Run the Downloader
  2. Select e621
  3. Type in any tags as long as they are, in total, longer than 256 characters
  4. See error

Expected behavior
Downloader should run normally (maybe allow users to name output folders / change them, as planned in #31)

Screenshot
image

Desktop:

  • OS: Windows
  • Version 11

Used Parameters and Settings:

  • Site: e621
  • Tool Version: v.1.6.3
  • Tags/Link (EXAMPLE): -vore -death -flash -fart -nipple_vore -breast_expansion -vore_pov -unbirthing -pooping -body_size_growth -urine -soiling -muscular -big_breasts -big_penis -thick_thighs ~de4dm1lk ~fleurfurr ~lettuce_(artist) ~kind_lurker ~ssevisx ~81yffulfmm ~noxxlss ~ruffruffles ~lintwave ~4hazelstreet ~uricomics ~dudles ~codyblue-731 ~100racs ~replicant_skrunkle ~lemonbird ~rilesthecat ~entom ~kyufuru ~lyonley ~slashkill ~domibun ~lilmoonie

runtime.log
runtime.log

Tag downloads for AI training

Would it be possible to add an option to download the tags associated with an image, possibly to a /metadata/[date][time][tags]/ directory?

[BUG] Errno 13 permission denied when trying to download a fav: tag

Errno 13 when trying to download fav:masuteri tag

To Reproduce

  1. run the app for the first time
  2. Set the blacklists to [], put in api key and name and save
  3. Run it again, choose e621 and as the tag fav:masuteri with pagecount left empty
  4. Observe

Expected behavior
All media should get downloaded

Screenshots
kuva

Desktop

  • OS: Windows
  • Version 11

Used Parameters and Settings (please complete the following information):

  • Site: e621
  • Tool Version: 1.4.3
  • Tags/Link: fav:masuteri

runtime.log

[REQUEST/MISSING] Differential/delta downloads not implemented

Is your feature request related to a problem? Please describe.
I see in the config.json that there is an option for oneTimeDownload, defaulted to true. There is no documentation around this, but I'd assume that if you turn oneTimeDownload to false then your downloads should become differential. In other words, if you download a tag that has 20 posts today, and tomorrow it has 25 (of which you already have 20), then re-running that download should only download the 5 posts that are missing.

Looking through the code, this does not seem to be implemented in any of the downloaders, and is only read from the config file in main.py.

Describe the solution you'd like
The oneTimeDownload feature should be implemented as described above.

Describe alternatives you've considered
It is easy enough to simply merge previously downloaded folders together for specific tag sets, however this causes multiple downloads of the same post, and therefore unnecessary requests to the site's API.

Additional context
This was tested on e621, but should also be non-functional on all other sites as the feature is simply not implemented.

Site URL
N/A

Does the site have an API?
N/A

[BUG] Any tag on E621

To Reproduce
Steps to reproduce the behavior:
Launch and configure the latest release of NNDownloader (1.4.2 at time of writing)

Expected behavior
A clear and concise description of what you expected to happen.
I type in a tag like "animated" and I get
Downloading |โš ๏ธŽ | (!) 0/320 [0%] in 0.8s (0.00/s)
[!] An error occured while downloading from e621! Please report this. Exception: cannot access local variable 'safe_user_tags' where it is not associated with a value

Any tag I type it doesn't work.

Screenshots
If applicable, add screenshots to help explain your problem.
EdPQHQa

Desktop (please complete the following information):

  • OS: Windows
  • Version 11

Used Parameters and Settings (please complete the following information):

  • Site: e621
  • Tool Version: NN
  • Tags/Link: animated

Please attach the runtime.log

runtime.log

[BUG] Auto updater never recognises that its up to date

Describe the bug
When using the auto updater, the update applies correctly. However, the auto updater still shows the application as outdated.

To Reproduce

  • Launch and configure the latest release of NNDownloader (1.4.0 at time of writing)
  • The auto updater will prompt you to download the "latest version"
  • Update to this version and relaunch NNDownloader
  • The auto updater still prompts to update

Expected behavior
The auto updater should not prompt you to update when you are on the latest version

Screenshots
image

Used Parameters and Settings (please complete the following information):
N/A

Additional context
I believe this issue is caused by a mismatch between the versioning provided by the GitHub API and checking against the version in the config file. I did try to modify the config version to 1.4.0, however this is not valid JSON as the version is currently stored as float.

This is from a quick glance through the code though and could be completely wrong - I'm not familiar with python.

[BUG] cannot access local variable 'meta_tags'

Describe the bug
I tried running the tag "tail" for E621 and got the error:
"[!] An error occured while downloading from e621! Please report this. Exception: cannot access local variable 'meta_tags' where it is not associated with a value"
Persists even when running the .exe as administrator

Tbh Idk how you'd reproduce it, I downloaded the .exe and after I ran it, set up the API etc. just couldn't download

Screenshots
image

Desktop:

  • OS: Windows
  • Version 11

Tool:

  • Site: e621
  • Tool Version: 1.6.0
  • Tags/Link: tail

I have to say that I am in no way a coder nor know anything about this. I already struggled with the API settings ๐Ÿ˜…

Runtime Log
runtime.log

Thanks in advance

[BUG] Artist tag refuses to download

More specifically, for some reason, it refuses to download anything by ConnivingRat off e621. I am on Win10.

Steps to reproduce the behavior:

  1. Select E621
  2. Type "connivingrat" and try to download any number of pages.
  3. ???

Screenshot:
image

For some reason there is no log file with the program either so I can't find out the error either...

[BUG] Error Message

Discussed in #28

Originally posted by Sakumaid111 May 3, 2024
Hi i'm getting an Error message but can't tell why i'm getting this

"An error occured while downloading from e621! Please report this. Exception: 'posts'"

I need help

heyy im kinda new at github and i dont actually know how to download it correctly (or at least how to execute it)

at first ive tried to click on "windows donwload"
but it ends creating and downloader wich just keeps creating 2 empty folders and one text (config)
and ive even tried to download it with linux but i wasnt able to to found an applicantion to actually start the nn-donwloader, since ive tried to open almost everysingle archive in that folder...

im pretty sure that im just being really stupid on trying to find how to use it but plz, help me TwT

btw excuse my bad english, im still learning it

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.