ripmeapp / ripme Goto Github PK
View Code? Open in Web Editor NEWDownloads albums in bulk
License: MIT License
Downloads albums in bulk
License: MIT License
Set up https://travis-ci.org/ripmeapp/ripme to replace https://travis-ci.org/4pr0n/ripme since we're moving to a new home (here).
Deam team.
Can we solve the issue from error to download from imagearn?
Issue by metaprime
Tuesday Apr 25, 2017 at 07:45 GMT
Originally opened as 4pr0n/ripme#510
If you would like to develop a ripper which has been requested, please open an issue (to function as a work item) indicating that you've claimed a ripper and you're working on an implementation. Please link back to this issue (and 4pr0n#502 as an FYI) so that GitHub makes a link to the issue (work item) appear in this thread and 4pr0n#502.
I'm locking this conversation to ensure requests and general comments stay on 4pr0n#502. (It looks like link-backs won't appear on a locked issue, so I won't be able to lock this issue.)
To keep this issue focused, I will delete requests and non-dev-related comments (please use 4pr0n#502 for these).
Below is a list of rippers and functionality requested via 4pr0n#502 and 4pr0n#8 (this list is a work in progress -- I'm posting a thumbs-up reaction on any requests I have added to this list). Please assume all links are NSFW.
DeviantART
: 4pr0n#272 4pr0n#112 4pr0n#63DeviantART
favorites galleries e.g. http://philosophyfetish.deviantart.com/favourites/ (Request)DeviantART
gallery recursive ripping (4pr0n#550)Tumblr
liked by {User}: https://www.tumblr.com/liked/by/hacky-gif (Request)eroshare
User Pages (4pr0n#465) and direct links (4pr0n#526)PurplePort
: https://purpleport.com/ e.g. https://purpleport.com/portfolio/bluethealienteafairy/ (Request)CFake
: http://cfake.com/ e.g. http://cfake.com/picture/Olivia-Munn/969 (Request, Comment, Comment)VSCO
: http://www.vsco.co e.g. https://vsco.co/lukept/images/1 (Request, Comment, Comment)zenfolio
https://en.zenfolio.com (Request)smugmug
https://www.smugmug.com/ (Request)sex.com
: (Request: 4pr0n/ripme#274)vidble.com
: video links https://www.vidble.com/watch?v=i82m7v88HHTl82DwgEfbZHQ7ySchrUZd Requestimageshack.com
: https://imageshack.com/a/vsWl/1 Requestgetgonewild
- http://www.getgonewild.com/profile/rollmeupblogspot
- http://marcherryfashion.blogspot.com/pixiv
- http://www.pixiv.net/member.php?id=2136123facebook
- https://www.facebook.com/EmanueleFerrariPhotographer/photos_streampinterest
- http://www.pinterest.com/lookbook
- http://lookbook.nu/mayowo4shared
- http://www.4shared.com/folder/pTUpT6wG/Heather.htmlbehance
- https://www.behance.net/HS-njdribbble
- https://dribbble.com/studioMUTIfetlife
- https://fetlife.com/users/2089769diverxity
- http://www.diverxity.com/users/953studio-g
- http://studio-g.tistory.com/535fg-site
- http://www.fg-site.net/members/umeume/gelbooru
- http://gelbooru.com/index.php?page=post&s=list&tags=futathefappening.sexy
- http://thefappening.sexy/albums/index.php?/category/126ipernity
- http://www.ipernity.com/doc/kimcums/album/676241punterplanet
- http://guide.punterplanet.com/escorts/featured/frontpage/amber-green_200.htmlrule34
- rule34.paheal.netphotoblog.pl
- http://www.photoblog.pl/colordust/170020651/typical-girl.htmlmegamodels.pl
- http://www.megamodels.pl/a-yamaxmodels.pl
- http://www.maxmodels.pl/modelka-agnes-z-garbledville.htmlflog.pl
- http://www.flog.pl/szukaj/aktflickr
- login support (see 4pr0n#32)vk
- Video ripper rename files (4pr0n/ripme#8 (comment))twitter
- Search ripping (4pr0n/ripme#8 (comment))gifyo
- Don't skip some images*chan rippers
- Handle external links (vocaroo), store commentstumblr
- Rip by date (/archive/year/month
) (4pr0n/ripme#8 (comment))artician
- http://zionenciel.artician.com/It would be nice to have the ability to pause the current url that is being ripped. We already have start and stop.
The addURLToDownload method in AbstractRipper should have sanitisation implemented for sub directories. It's currently possible to pass invalid characters and have the directory creation fail. This is particularly an issue on Windows platforms.
Another side effect of no sanitisation is that slashes in the directory name create further subdirectories.
java -version
): 1.8.0_131It would be nice if the "clear" button in the history tab would ask for confirmation, to prevent accidentally clearing history.
java -version
): 1.8_131Log:
Downloading http://smutty.com/h/somehashtag/?q=%23somehashtag&page=1&sort=date&lazy=1
Rip complete, saved to D:...\smutty_somehashtag
no protocol: //s.smutty.com/media_smutty_2/p/i/n/k/b/pinkjackrabbit-xr2nw-c5f4e0.jpg
Also it would be nice to be able to download the images you've liked from this URL: https://smutty.com/user/username/like/
Sometimes, the images in one Tumblr post don't have the same name and thus can't be viewed sequentially with e.g. MComix. It'd be nice to add an option that'd append the number of the post to the tumblr image file name and maybe also an counter to maintain the order of images inside a post.
Issue by metaprime
Wednesday May 24, 2017 at 18:34 GMT
Originally opened as 4pr0n/ripme#557
@Gaboso Let's talk about which changes need to be done, style guidelines, etc. If we're going to make a push to improve code quality, let's also strive for consistency.
java -version
): 8.0.1310.11Rips said link.
Says "Failed to load insert pornhub album link here" Same result goes for other links as well.
Tumblr in question is fiveonetwocouple.tumblr.com. You can't view the blog if you aren't logged in, and when you log in it opens as a side thing in your dashboard with a different url. RipMe only likes name.tumblr.com format so it's not able to rip this one.
v1.5.7
When downloading galleries, there's a huge pause between pages with "downloading next page" message in log. I've tried reducing and increasing timeout in settings to get rig of that pause, but it isn't working.
Tried with random galleries.
P.S. It would also be nicie to have an extra option in settings, that would allow to download not only the main gallery, but also the folders. Thanks.
java -version
): 1.7.0_79oneballharry.tumblr.com
and bear-lounge.tumblr.com
)It downloads one link, Stop button is functional, then moves to next link
It tries to download two URLs simultaneously and Stop button is disabled (as shown by disk monitor, log and pending counter jumping between two ranges)
It would be nice if there is an option to RIP only newly added (but not already downloaded) images in a user's favorites.
One way to do that is to stop ripping if a threshold of already downloaded files have been reached instead of continuing to request the files all the way till the end :)
Still, I have got the No compatible rip is found on URL.
These are the messages I have got know.
Please let me know the substitute for this?
It downloaded the first image in the 207 image album and then stopped claiming it was done and returning "Error: null"
The site spacescience.tech provides a mirror of eroshare (With content being hosted on the Internet Archive's Wayback Machine). The mirrors been up for ~ a month
The eroshare ripper should both rip from spacescience.tech when given a eroshare link (https://eroshare.com/dt0kt9hu -> https://spacescience.tech/dt0kt9hu) and accept spacescience.tech links
See #5
As mentioned in comments on PR #29
@cyian-1756 FYI
'mvn test' is failing. I have attached the output here.
Still, I have got the same compatibility issue out there.You have to look it out on your own.
I've seen that ripme grabs what I believe is the highest quality available. Sometimes 20 second clips are on the 100 MB size and honestly my network isn't that fast to download many files with such size.
Gfycat has several quality "presets". For example I would like to download every file hosted there in the mobileUrl quality (links are thumbs.gfycat.com/NameOfTheGfy-mobile.mp4"
Is this achievable?
java -version
): 1.8.0_131Get the images links with correct file extensions and download them.
All the image links are parsed having ".jpg" extension but some of the images are ".png" or other extensions on the site server, resulting in 404 errors when trying to download them.
Example:
When trying to download the images from the link: https://chan.sankakucomplex.com/?tags=kunaboto
RipMe gets the link:
https://cs.sankakucomplex.com/data/23/90/2390750eb665e15d0393733a31bd0632.jpg?6170028
When it should be:
https://cs.sankakucomplex.com/data/23/90/2390750eb665e15d0393733a31bd0632.png?6170028
Then RipMe cant download the image because the file extension on the link is wrong.
The same happens for all ".png" images.
Please open a new issue if you're reporting a problem in the ripper for a site we already support. This issue is to request support for new sites.
This issue replaces 4pr0n/ripme#8 and 4pr0n/ripme#502 which had gotten too huge to load or peruse in a reasonable amount of time.
This will give an opportunity to actually look at the older requests without new requests coming in to make that more difficult, and will help to see the more modern requests.
4pr0n/ripme#510 (now #43) will track received requests and aggregate links to the work in progress on each request.
Already-supported sites: https://github.com/4pr0n/ripme/wiki/Supported-Sites
Tries to rip URLs using this URL: https://cdn.ampproject.org/i/s/www.8muses.com/data/ufu/small/c85caANovBvr3UgRAqgT2zzp4djcgBJgudsWdTY+NjPKb02Z64ZTsyZqRC7WqbRrOURwAfNmNE79rvXd-+2aax6cobhJZn4vVH8GopOPWVUL92qo.jpg
where actual URL from the site should be: https://cdn.ampproject.org/i/s/www.8muses.com/data/fu/small/c85caANovBvr3UgRAqgT2zzp4djcgBJgudsWdTY+NjPKb02Z64ZTsyZqRC7WqbRrOURwAfNmNE79rvXd-+2aax6cobhJZn4vVH8GopOPWVUL92qo.jpg
Just a small change from: /data/ufu/, to /data/fu/
java -version
): NARipme should inform the user of the exact error (Http: 429 too many requests), tell them that it is because of over use of the api key and link them to a page detailing how to change the key.
Ripme reports null
java -version
): 1.8.0_131Rip should download all comics under bimbo-story-club-comics
Ripme returns null and the debugging output of
Retrieving full-size image location from https://www.8muses.com/comix/album/various-authors/offworld-trooper/a-geonosian-incubation
Got exception while running ripper:
java.lang.NullPointerException
at com.rarchives.ripme.ripper.rippers.EightmusesRipper.getFullSizeImage(EightmusesRipper.java:147)
at com.rarchives.ripme.ripper.rippers.EightmusesRipper.getURLsFromPage(EightmusesRipper.java:126)
at com.rarchives.ripme.ripper.AbstractHTMLRipper.rip(AbstractHTMLRipper.java:71)
at com.rarchives.ripme.ripper.AbstractRipper.run(AbstractRipper.java:353)
at java.lang.Thread.run(Thread.java:748)
Waiting for threads to finish
And all the images it tries to download 404
The issue I'm experiencing seems to be a common one--when I try to rip from Tumblr, I get a message saying "null." There are multiple threads about this issue but I can't seem to resolve the problem even with a new API key. I think some explicit and detailed instructions would benefit me and others in the future who have no idea what the hell we're doing. Steps that may seem obvious to some may not be obvious to everyone.
Anyway, here's what I've tried so far:
I'm sure there's some obvious thing I'm missing, but like I said, I don't really know what I'm doing. Any help is appreciated.
Since eroshare is gone, I would love to see support for erome.com.
Once the newest 24 images are downloaded, RipMe believes it is at 100% and stops. Is there a configuration to make sure the entire gallery downloads?
java -version
):the expected behavior is that it is supposed to download the files.
"Can't rip this URL: com.rarchives.ripme.ripper.rippers (null) does not appear to be a valid package"
Converted from: 4pr0n/ripme#502 (comment) by @Flip32
Hi, It seems Imagebam it's not working! And when does, the pics come smaller.
Can you help me?ex.: http://www.imagebam.com/gallery/72c5utvqv44wcqnkc9vzapm5yck8j1cr
English is not my native language.
I used RipMe 1.3 for many years, but he started to show an error. I downloaded 1.5.2 and it gives another error "Null".
Obs: RipMe 1.3 Error: "Failed to load http://api.tumblr.com/v2/blog/..."
I always see people saying to "replace the tumblr api key (tumblr.auth in rip.properties) with your own tumblr api key."
I create an app for me at this link but i dont know what is an API KEY, how its loke like, and where can i find it?
https://www.tumblr.com/oauth/apps
And most important I dont know how/where to raplace the Api Key...
The only file I have is "ripme" and the folder "rips.
Any help? Thanks.
I'm working on ripping Imgsrc.ru, it has the following steps:
Get URLs to albums
Each page contains 50 URLs that can easily be sanitized into the album URL. (What method do I use for this?)
Each album URL contains a number of sub-URLs. (What method do I use for this?)
Each sub-URL do I use the following methods to download all images from the site.
getURLsFromPage()
downloadURL()
This is the part that works just fine.
i need the rip to download the images from all the album inside not just the preview thumbnails
See discussion in #17
Instagram ripper can handle ripping posts when starting from a profile page. Should be able to handle links to individual posts.
Trying to rip a page which is a direct link to a post does not work.
I am developing a Facebook ripper, and it's currently in the early functional stage. Further details will be posted here later.
Issue by metaprime
Wed May 24 18:16:47 2017
Originally opened as 4pr0n/ripme#556
https://github.com/up-for-grabs/up-for-grabs.net
Use label https://github.com/4pr0n/ripme/labels/up-for-grabs
It's not complicated, but the resources are not grouped anywhere
Read:
Ripper requests (first ripper / first PR):
Other easy issues (up for grabs, your first PR):
The ripper should download the original size images.
The ripper download the resized images.
Example :
This image https://members.luscious.net/c/western_hentai/pictures/album/art-by-aka6_257791/id/18066879/#aka6-535020-shitty-feeding-ninja has an original resolution of 1167x1400 but it download the resized 1024x1228 image instead.
(The original resolution image can be accessed by clicking on the download button of the specified image situated on the bottom right of the resized image)
Extras :
For this image : https://members.luscious.net/c/western_hentai/pictures/album/art-by-aka6_257791/id/18066879/#aka6-535020-shitty-feeding-ninja
the ripper download this image : https://cdnio.luscious.net/slywalker_96/257791/aka6-535020-shitty_feeding_ninja_01BRHMZWH9PM8NE6KRG09E2F68.1024x0.jpg
while it should download this one instead : https://cdnio.luscious.net/slywalker_96/257791/aka6-535020-shitty_feeding_ninja_01BRHMZWH9PM8NE6KRG09E2F68.jpg
I have downloaded a lot of albums at this point, and I frequently use the "Re-Rip Checked" option to download new content in said albums. The problem is, if there are any images in the albums that I delete (mostly filler images, thumbnail versions, etc), they all get re-downloaded when I re-rip.
So my suggestion (slash question as to if it's even possible) is as what the title says: Would it be possible to add a check/toggle option to disable the downloading of files older than the last rip, specifically when re-ripping albums? That may or may not even make the re-ripping even faster, as it would force it to skip over images older than set date/time, which would mean it wouldnt have to check if a file has already been downloaded.
I have installed the RipMe 1.5.3 version.But as per bounty requirement, the need is around at 1.5.2 version and Os requirement is Windows 10 and Java Version requirement is (V8 131).
I tried it to run that on RipMe 1.5.3 version.It would not work out.
and show that error is for URL attachment is not valid.
Cannot rip this URL: No compatible ripper found!
Ripme version: 1.5.7
Java version:
openjdk version "1.8.0_131"
OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.16.04.2-b11)
OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
Operating system:
NAME="Linux Mint"
VERSION="18.2 (Sonya)"
ID=linuxmint
ID_LIKE=ubuntu
PRETTY_NAME="Linux Mint 18.2"
VERSION_ID="18.2"
HOME_URL="http://www.linuxmint.com/"
SUPPORT_URL="http://forums.linuxmint.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/linuxmint/"
VERSION_CODENAME=sonya
UBUNTU_CODENAME=xenial
Exact URL you were trying to rip when the problem occurred: https://xhamster.com/videos/skinny-babe-handjob-and-big-cumshot-7776912
Please include any additional information about how to reproduce the problem:
Rip video.
No compatible ripper found
I'm thinking I'll use this to migrate issues: https://github.com/IQAndreas/github-issues-import
Another option is https://github-issue-mover.appspot.com/ but it looks like it's more of a one-at-a-time kind of thing
No need to manually reopen issues here before they are closed over there. Tracking them in only one place is easier.
java -version
): openjdk version "1.8.0_131"The album rips
ripme outputs
org.jsoup.HttpStatusException: HTTP error fetching URL. Status=404, URL=https://www.instagram.com/p/media/
I would love to see support for ripping tags from wallhaven.cc.
Downloads full album
Downloads just the page given in the url
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.