metafates / mangal-scrapers Goto Github PK

View Code? Open in Web Editor NEW

37.0 37.0 25.0 39 KB

🌙 A collection of custom scrapers for mangal

Lua 100.00%

mangal-scrapers's People

Contributors

Stargazers

Watchers

mangal-scrapers's Issues

cant find lua html module

I hate to open an issue for something seemingly simple like this but I cannot for the life of me find where the Lua module "html" that is used in the scrapers can be installed. I don't see it on luarocks anywhere. I wrote a few manga scrapers in python for a couple of sites and I would like to port them over to Lua but I'm still fairly new to the process of managing dependencies in Lua.

Just for clarification can you point me to where the correct html and https modules are?

[Source Request] Please add ninemanga as source!!

Please can add the source Ninemanga
URL: https://ninemanga.com/
Have several languages (English Español русский Deutsch Italiano Brasil Français)
it´s a great site with daily updates!!

thanks!!

You can add support for scan-manga

Hi, there,

Unfortunately I'm not good enough in dev to do it could a kind soul do it for the site: https://www.scan-manga.com

I tried with chatgpt without success

Adding support for Asura Scans

Adding support for Asura Scans and other Madara themed sites would be nice. I'd assume that it would be similar to the Luminous Scans scraper(although I haven't been able to make it work yet). Or even a blank template of sorts for these sites would work

None of these work for me running on a Raspberry PI 4 32bit-arm

The built inn sources for Mangal seems to work fine, but none of these extra sources work at all. Getting different errors depending if its an "headless chrome" source or not.

 Error

  X Uggh, something went wrong. Maybe try again?

  I used to download stuff without any errors, then I took an arrow to the knee. By arrow I mean this:

  /home/knarf/.config/mangal/sources/AsuraScans.lua:22: attempt to index a non-table object(nil) with key 'page'
  stack traceback:
      /home/knarf/.config/mangal/sources/AsuraScans.lua:22: in main chunk
      [G]: ?

enter confirm • tab accept search suggestion • ctrl+c quit
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0x9c7f34]

goroutine 131 [running]:
github.com/metafates/mangal/tui.(*statefulBubble).searchManga.func1.1({0x0, 0x0})
	github.com/metafates/mangal/tui/handlers.go:156 +0x78
created by github.com/metafates/mangal/tui.(*statefulBubble).searchManga.func1
	github.com/metafates/mangal/tui/handlers.go:154 +0x244

When using Mangasee headless chromium-1033860 browser crashes on some entries.

When I try to download some chapters on certain manga entries on MangaSee headless chromium connector version 1033860; mangal crashes with the following error. I am using the latest git version of the scrapers and mangal itself.
The following example entry crashes each and every time I tried.
My Isekai Life - I Gained a Second Character Class and Became the Strongest Sage in the World
┃ https://mangasee123.com/manga/Tensei-Kenja-No-Isekai-Raifu

esc back • ctrl+c quit                                                                                                     
panic:  field of "url" is required                                                                                           
stack traceback:
	[G]: ?

goroutine 197 [running]:
github.com/yuin/gopher-lua.panicWithTraceback(0xc0005809c0?)
	<PATH>/mangal/vendor/github.com/yuin/gopher-lua/state.go:601 +0xa5
github.com/yuin/gopher-lua.(*LState).raiseError(0xc000398000, 0x1, {0xc0005809a0?, 0x1a?}, {0x0?, 0x0?, 0x0?})
	<PATH>/mangal/vendor/github.com/yuin/gopher-lua/state.go:696 +0x25d
github.com/yuin/gopher-lua.(*LState).RaiseError(...)
	<PATH>/mangal/vendor/github.com/yuin/gopher-lua/state.go:1671
github.com/metafates/mangal/provider/custom.(*luaSource).PagesOf.func1({0x15526a0, 0xc0003cd0b0}, {0x1551a60?, 0xc0001438c0?})
	<PATH>/mangal/provider/custom/pages.go:31 +0x1f5
github.com/yuin/gopher-lua.(*LTable).ForEach(0xc000143680, 0xc0005d9c60)
	<PATH>/mangal/vendor/github.com/yuin/gopher-lua/table.go:330 +0x2fa
github.com/metafates/mangal/provider/custom.(*luaSource).PagesOf(0xc000504900, 0xc00069e200)
	<PATH>/mangal/provider/custom/pages.go:19 +0x135
github.com/metafates/mangal/downloader.Download(0xc00069e200, 0xc00045af50)
	<PATH>/mangal-git/src/mangal/downloader/download.go:43 +0x359
github.com/metafates/mangal/tui.(*statefulBubble).downloadChapter.func1()
	<PATH>/mangal/tui/handlers.go:250 +0x98
github.com/charmbracelet/bubbletea.(*Program).StartReturningModel.func6.1()
	<PATH>/mangal/vendor/github.com/charmbracelet/bubbletea/tea.go:469 +0x33
created by github.com/charmbracelet/bubbletea.(*Program).StartReturningModel.func6
	<PATH>/mangal/vendor/github.com/charmbracelet/bubbletea/tea.go:467 +0x14d

I also found several other entries/links. It seems that if the entry has many chapters, it fails with the "url is required"
message. Though one with 117 chapters did successfully download. The above example only had 73 chapters to be downloaded. I did try to download several single chapters randomly and it result was the same.

[Source Request]- Add MAngafire as a scraper

Please add mangafire.to as a plugin , since it has a large collection of mangas,mahuas and manhwas than all the the ones in the list

ComicK scraper not working

When trying to use the ComicK scraper I am getting this issue.
Doesn't matter what manga I try and get it to work with, all of them end up with this error.

Error                                                                                                 
                                                                                                         
  X Uggh, something went wrong. Maybe try again?                                                         
                                                                                                         
  Fighting an endless army of errors and bugs Mangal died a hero. Their last words were:                 
                                                                                                         
  /config/.config/mangal/sources/ComicK.lua:72: cannot perform div operation between nil and number      
  stack traceback:                                                                                       
      /config/.config/mangal/sources/ComicK.lua:72: in main chunk                                        
      [G]: ?

   Error

  X Uggh, something went wrong. Maybe try again?

  I used to download stuff without any errors, then I took an arrow to the knee. By arrow I mean this:

  /home/adhiraj/.config/mangal/sources/ComicK.lua:44: bad argument #1 to pairs (table expected, got nil)
  stack traceback:
      [G]: in function 'pairs'
      /home/guest_user/.config/mangal/sources/ComicK.lua:44: in main chunk
      [G]: ?

LuminousScans scraper doesn't work

add toonily scraper

I want to add toonily to my scraper: https://toonily.com/

How do i add it. never used lua before?

metafates / mangal-scrapers Goto Github PK

mangal-scrapers's People

Contributors

Stargazers

Watchers

Forkers

mangal-scrapers's Issues

Recommend Projects

Recommend Topics

Recommend Org