Git Product home page Git Product logo

Comments (3)

santosderek avatar santosderek commented on June 5, 2024

Thank you for letting me know! I know that the Imgur API supports up to 12,500 requests per day so you shouldn't be hitting that barrier unless you have more than 10,000 images, allowing 2500 for API calls.

I will implement a way to start at a certain "page", (something like itf --download-latest-favorites [username] --page-start 51) so that you should be able to pick up where you left off. Please allow me some time to implement this.

In the current implementation, when a user executes imgurToFolder --download-latest/oldest-favorites [username] it will create a list of all known favorites (at least as much as the api gives), and will skip over already downloaded images. So currently if you run the imgurtofolder command in the same directory as before, it should skip over already downloaded files, and will not use additional API calls / GET requests during this skip.

Also if you use imgurToFolder --list-all-favorites [username] | OR | imgurToFolder -lf [username], at the very top if should give you a number of known favorites that it was able to find. Is that number more that 3060?

Lastly, (sorry for the block of text), I will be implementing the --page-start feature in the next version. I will also figure out why it is stopping specifically at 51 pages.

I hope this helps! If there is something else I can improve or you have suggestions of what to implement let me know!

from imgur-to-folder.

Sylvanas1000 avatar Sylvanas1000 commented on June 5, 2024

I don't think I've quite reached 10,000 images in my favorites yet, so I don't think that's the issue here.

When I run imgurToFolder --list-all-favorites [username] | OR | imgurToFolder -lf [username], it returns with 3060 favorites that it finds, although I have more, so like I said, I think this might be a cap with imgur's API.
I appreciate your reply and look forward to seeing if you can resolve this issue in a future update.

from imgur-to-folder.

Marooned-MB avatar Marooned-MB commented on June 5, 2024

Also if you use imgurToFolder --list-all-favorites [username] | OR | imgurToFolder -lf [username], at the very top if should give you a number of known favorites that it was able to find. Is that number more that 3060?

Unfortunately, imgurToFolder does not print to standard output so I can't do python imgurToFolder -lf username > list.json nor | more and the buffer limit in windows console is 9999 lines - this is not enough to see the top of that output so no way of telling what's there.

The program only download 396 Files, 28 Folders of my favs. Way less than said API limit and even less than 3600 mentioned in this ticket.

[edit]
I was able to download more using --start-page param.

from imgur-to-folder.

Related Issues (18)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.