sn0wcrack / exhen-archive Goto Github PK
View Code? Open in Web Editor NEWSystem for crawling/archiving and viewing ExHen galleries
License: The Unlicense
System for crawling/archiving and viewing ExHen galleries
License: The Unlicense
Sorry for opening another issue this fast.. Noticed this error, cover images are not showing.
The www/images
directory doesn't exist, was it supossed to be generated automatically? Even after I created it cover images still not shown
This is my current apache configuration
<VirtualHost *:80>
DocumentRoot "/www/all/exhentai-archiver/www"
ServerName exhen.localhost
<Directory "/www/all/exhentai-archiver/www">
AllowOverride None
Order allow,deny
allow from all
</Directory>
Alias /images "/www/all/exhentai-archiver/www/images"
<Directory "/www/all/exhentai-archiver/www/images">
AllowOverride None
Order allow,deny
Require all granted
</Directory>
</VirtualHost>
I'd like to propose to replace the current logging implementation with https://seldaek.github.io/monolog/.
Reason for this is that monolog is a widely supporting logging library with support of many handlers, and many other things.
In my case, running in docker, i want to log to either file, console output and/or a remote logging server.
The easiest implementation for now would be in my opinion:
Optional:
When switching the views with the button, the view changes to multipage view and then you cant switch back.
<div class="switches-outer"> <label> <span>SPV</span> <input type="checkbox" name="viewertype" value="0" class="fancy-switch viewtype" /> <div> <div></div> </div> <span>MPV</span>
This is the portion of code im referring to
The main part that seems to fail is this https://github.com/Sn0wCrack/ExHen-Archive/blob/master/classes/ExArchiver.php#L172-L189
The thing that I notice is the following, the getArchiverUrl
will find the following url https://exhentai.org/archiver.php?gid=<gid>&token=<token>&or=<somenumber>--<hash>
after that I see that code does buttonPress
and ExPage_Archiver
.
I guess the way it worked before, it directly triggered the "download original" and got the right links.
Right now, if you visit the Archiver page, the "download original" is now a form, that requires a POST and uses the same URL that is found before, but one less dash https://exhentai.org/archiver.php?gid=<gid>&token=<token>&or=<somenumber>-<hash>
So it's probably the easiest way to replace https://github.com/Sn0wCrack/ExHen-Archive/blob/master/classes/ExArchiver.php#L179 with a POST and replace --
with -
.
From https://github.com/Sn0wCrack/ExHentai-Archive/blob/master/setup/Linux-Setup.md#cron
Audit - updates meta data for added galleries. Will typically update each gallery periodically for new tags, or add newer versions of that gallery to the database.
It does not seem to do any metadata or tag updating as it is apparently supposed to, it just rotates the sphinx indexes.
Okay so hopefully I'm not doing something amazingly wrong this time, but none of my feed items seem to be grabbing new galleries for a feeds that have new items. It just reports 0 archived galleries, no errors or anything. I don't believe the config file is at fault this time since I copied my uconfig and hath_perks over after the last issue. Manually added galleries via the userscript are unaffected, just the feed process.
Here is the process:
DEBUG: [2016-08-12 06:35:05][TaskRunner] Running task Task_Archive
DEBUG: [2016-08-12 06:35:05][ExArchiver] Crawling feed "artist:artistnamegoeshere$", page 0
DEBUG: [2016-08-12 06:35:06][ExArchiver] Archive complete. Archived 0 galleries.
DEBUG: [2016-08-12 06:35:06][TaskRunner] Finished running task Task_Archive
Hopefully you can help me out by letting me know if your feeds work @Sn0wCrack, and if so where I may be going wrong.
Whenever I type a keyword it wont show a preview like it should and it infinitely loads when I hit enter.
I am on Ubuntu 16.04 and using apache2
Hi, today i install your program. All ok in the setup, but at search for anything i get nothing.
In the console show:
Failed to load resource: http://127.0.0.1:8080/api.php?search=&page=0&order=posted&action=galleries the server responded with a status of 500 (Internal Server Error)
The error is from the server but i don't get it, is from e-hentai server ? or local server?
Info:
-Used "Vagrant Setup" (currently trying "Windows Setup"...)
-Windows 8.1 (Admi)
-Virtualbox & Vagrant (last version)
-Default value at "accessKey" (if change, nothing happend)
Thanks.
Request url:http://exhen.localhost/api.php?search=&page=0&order=posted&action=galleries
Error message:
<b>Fatal error</b>: Uncaught exception 'PDOException' with message 'Could not connect to database (exhen).' in /home/wwwroot/exhen/lib/rb.php:422
Stack trace:
#0 /home/wwwroot/exhen/lib/rb.php(253): RedBean_Driver_PDO->connect()
#1 /home/wwwroot/exhen/lib/rb.php(431): RedBean_Driver_PDO->runQuery('select * from g...', Array)
#2 /home/wwwroot/exhen/lib/rb.php(2339): RedBean_Driver_PDO->GetAll('select * from g...', Array)
#3 /home/wwwroot/exhen/lib/rb.php(9111): RedBean_Adapter_DBAdapter->get('select * from g...', Array)
#4 /home/wwwroot/exhen/lib/rb.php(9886): RedBean_Facade::query('get', 'select * from g...', Array)
#5 /home/wwwroot/exhen/classes/SphinxQL.php(30): RedBean_Facade::getAll('select * from g...', Array)
#6 /home/wwwroot/exhen/classes/Model/Gallery.php(78): SphinxQL::query('select * from g...', Array)
#7 /home/wwwroot/exhen/classes/ApiHandler.php(28): Model_Gallery::search('0', 24, '', 'posted', 0, false, false, false)
#8 /home/wwwroot/exhen/classes/ApiHandler.php(542): ApiHandler->galleriesAction()
#9 /home/wwwroot/e in <b>/home/wwwroot/exhen/lib/rb.php</b> on line <b>422</b><br />
Environment:
I am following the vagrant setup. I've already input my ipb_member_id and ipb_pass_hash values in the config.json.linux file before
I dragged the userscript to firefox my browser of choice. I am using Windows 7 x64
My baseUrl is https://localhost
The send to archive button does not show up in the search result page, but it does show up when you go in to a specifik gallery. And I have cycled through all watch options on the search page (thumbnail, minimal, e.t.c.).
Hi, haven't tested your program yet (lazy for setting up all the servers) but seems good
as I have understand it will change exhentai interface and allows to download galeries and easilly allows reading them on the same interface
does it save all tags for being able to search by tag later?
I'm looking for something that:
show which tags from tag perk are on that doujin, maybe not even needing tag perk?
here's an example of my current exhentai, as you can see, english galeries are green and readed galeries are a bit transparent this was done using eh plus:
http://snag.gy/Fjygb.jpg
Main feature I'm looking for is some way to keep updated about my favourite authors, being able to see a list of translated doujins pending to be read for each favourite author, I would be able to do this just by searching all my favourite author names, but exhentai search is limited to a few words, so no idea about how to implement that
could you add these features to your project or I'm asking too much?
As I referenced here f7a8369#commitcomment-18600279 I'm having trouble getting downloads to work with the recent download options change at exh.
I get this when I try to archive something:
ERROR: [2016-08-11 03:04:25][ExArchiver] Downloaded file is not an archive for gallery:
The file itself is just the page HTML with stuff like:
The file was successfully prepared, and is ready for download.
I'm using php7 on the machine, if that matters.
I did just setup this instance to test it so it isn't impossible I've done something wrong, however I'm a user of the original one from kimoi(okawus) so I have done it before.
On Windows 10, in order to get sphinx running with the given configuration file I had to delete the following line in order to run
enable_star = 1
Not doing so causes the following error on running searchd or indexer
ERROR: unknown key name enable_star
Also had to do the following in order to get it to run with Sphinx 3.3.1
https://sphinxsearch.com/forum/view.html?id=16497
Download a previous release (3.1.1) and copy the following assemblies from the bin
directories:libeay32.dll
msvcr120.dll
ssleay32.dll
Can this be added on the windows-setup file?
Lastly there is this problem when archiving gallery, after running TaskRunner and gallery archived, they wont show immediately. and I have to index them manually. This error is displayed when indexer is ran after archiving
DEBUG: [2021-01-24 23:55:13][ExArchiver] Archive complete. Archived 1 galleries.
Sphinx 3.3.1 (commit b72d67bc)
Copyright (c) 2001-2020, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
using config file './sphinx.conf'...
indexing index 'galleries'...
collected 2 docs, 0.0 MB
sorted 0.0 Mhits, 100.0% done
total 2 docs, 1.1 Kb
total 0.1 sec, 19.3 Kb/sec, 34 docs/sec
indexing index 'suggested'...
collected 26 docs, 0.0 MB
sorted 0.0 Mhits, 100.0% done
total 26 docs, 0.2 Kb
total 0.0 sec, 5.1 Kb/sec, 566 docs/sec
WARNING: could not open pipe (GetLastError()=5)
WARNING: indices NOT rotated.
DEBUG: [2021-01-24 23:55:13][TaskRunner] Finished running task Task_Archive
Fixed the problem, confused the pass with user, since the order is different.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.