suwmlee / ikaros Goto Github PK

文件番号强制重命名并把标签设置为未搜刮，后刷新搜刮 日志报错！

[2023-04-10 10:55:57,763] init ERROR : Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/flask/app.py", line 1820, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/flask/app.py", line 1796, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/src/controller/scrapingctrl.py", line 30, in startScrapingdirect
startScrapingSingle(cid, filepath, True)
File "/app/src/bizlogic/manager.py", line 219, in startScrapingSingle
if os.path.exists(movie_info.destpath):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 19, in exists
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

[2023-04-10 11:17:34,312] manager INFO : [+]Single start!!!
[2023-04-10 11:17:34,316] init ERROR : Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/flask/app.py", line 1820, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/flask/app.py", line 1796, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/src/controller/scrapingctrl.py", line 30, in startScrapingdirect
startScrapingSingle(cid, filepath, True)
File "/app/src/bizlogic/manager.py", line 219, in startScrapingSingle
if os.path.exists(movie_info.destpath):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 19, in exists
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

自定义转移内容后，可直接应用，不需要等待第二次执行

这个大小限制是大于设置的大小的文件吗
是这样设置的吗

This typically means that you attempted to use functionality that needed
to interface with the current application object in some way. To solve
this, set up an application context with app.app_context(). See the
documentation for more information.
[2022-05-09 14:35:29,340] scraper INFO : [-]Move to Failed folder
[2022-05-09 14:35:30,009] manager INFO : [*]======================================================
[2022-05-09 14:35:31,209] manager INFO : [!]Making Data for [/media/new/DASS-002.mp4], the number is [DASS-002]
[2022-05-09 14:35:32,223] init INFO : [+] Multi threading enabled
[2022-05-09 14:35:39,630] manager ERROR : [!] ERROR: [/media/new/DASS-002.mp4]
[2022-05-09 14:35:39,631] manager ERROR : Working outside of application context.

大佬请教下这是什么问题, 用的硬链接

因为jav有jav的emby插件可以刮削了.现在只想要一键批量命名的功能.最好是检测到S1或S01文件夹的情况下,子目录里的智能预设批量命名成S1E1 S1E2之类的.同理检测到S2或S02的子目录就全部命名成S2E1 S2E2

使用的是最新版：web_42255e8 core_2.0.10

[2023-10-21 16:40:10,284] INFO in init: Initialization: upgrade db
[2023-10-21 16:40:13,340] INFO in init: Initialization: start
[2023-10-21 16:40:13,357] INFO in init: Initialization: set loglevel 20
[2023-10-21 16:40:13,361] INFO in automation: TaskQueue: found 0 task.
[2023-10-21 16:40:13,362] INFO in init: Initialization: finished
[2023-10-21 16:40:47,339] INFO in manager: [+]Single start!!!
[2023-10-21 16:40:47,422] ERROR in init: Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/flask/app.py", line 1484, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/app.py", line 1469, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/src/controller/scrapingctrl.py", line 30, in startScrapingdirect
startScrapingSingle(cid, filepath, True)
File "/app/src/bizlogic/manager.py", line 232, in startScrapingSingle
if conf.refresh_url:
^^^^
UnboundLocalError: cannot access local variable 'conf' where it is not associated with a value

/init: 37: exec: s6-overlay-suexec: Exec format error

由于我的，下载目录和存储目录不在同一个，存储空间 没法使用硬链接，现使用 ikaros 中配置输出模式为：移动文件，会导致 qbittorrent 显示丢失文件，没办法做完上传，自动删除任务

能否，在刮削选项中，加一个输出模式为 "复制文件"

之前一直使用 Movie_Data_Capture 奈何昨天不知道为什么突然出错了，所以改用你写的 ikaros，使用后感觉有界面还是会方便，根据日常使用有几个问题：
1 能否增加登录用户名密码，以方便外网访问。
2 能否自定义 水印 的颜色？习惯 Movie_Data_Capture 风格的标签了，颜色突然更换有点不太适应
3 移动方式刮削完成后能否自动删除源文件夹？很多av下载后，文件夹里除了视频文件还有好多推广用的视频跟图片等文件，最好能设置一个选项，在文件夹小于指定大小（例如100mb）时自动删除
4 能否自定义后缀？Movie_Data_Capture 例如原版对于 -UC 的后缀不识别，还有就是下载的av分多集的时候，后缀是_1 _2 如何识别？
5 部分av文件名前边会有3位数字，导致无法识别，最好能解决下
6 FC2PPV系列，以FC2PPV开头时，会无法识别，将文件名修改成 FC2- 后就可以正常识别，如何解决？
7 如何自动刮削？是监控文件夹变化吗？
8 能否做一个刮削目录名称的变量，例如，刮削完成后，是否可以移动到 /media/2023-09/#整理完成？

综上所述，建议能否增加一个文件名处理的规则，可以自定义添加多个规则，可以用替换法检测开头指定位数字符或者结尾字符等方式进行替换，或者正则实现。

标签样式参考下原版

您好，在我的 OpenWRT 系统上，对一些文件夹路径处理有问题，以下是日志：

[2022-11-10 18:29:05,019] INFO in manager: [+]Single start!!!
[2022-11-10 18:29:05,045] INFO in manager: [!]Making Data for [/app/data/downloads/transmission/SSIS-499-C/SSIS-499-C.mp4], the number is [SSIS-499]
192.168.137.220 - - [10/Nov/2022 18:29:07] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:09] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:11] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:13] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:15] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:17] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:19] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:21] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
192.168.137.220 - - [10/Nov/2022 18:29:23] "GET /api/scraping/record?page=1&size=10&sortprop=&sortorder=&blur= HTTP/1.1" 200 -
[2022-11-10 18:29:24,211] INFO in scraper: [-]Cover cut failed!
[2022-11-10 18:29:24,213] ERROR in manager: [!] ERROR: [/app/data/downloads/transmission/SSIS-499-C/SSIS-499-C.mp4]
[2022-11-10 18:29:24,214] ERROR in manager: [Errno 2] No such file or directory: '/app/data/downloads/ikaros/output/河北彩花/SSIS-499 最愛の人と数年ぶりの再会…一緒に過ごせる僅か数時間は寝る間も惜しんでSEXがしたい。 河北彩花/SSIS-499-C-poster.jpg'
[2022-11-10 18:29:24,215] INFO in scraper: [-]Move to Failed folder
[2022-11-10 18:29:24,272] INFO in manager: [*]======================================================
[2022-11-10 18:29:24,299] INFO in manager: [+]Single finished!!!

文件夹是存在的：
root@OpenWrt:/app/data/downloads/ikaros/output/桃乃木かな,涼美ほのか# ls
IPX-243 巨乳全開で猛アピールしてくる僕の彼女の小悪魔妹 桃乃木かな
root@OpenWrt:/app/data/downloads/ikaros/output/桃乃木かな,涼美ほのか# pwd
/app/data/downloads/ikaros/output/桃乃木かな,涼美ほのか
root@OpenWrt:/app/data/downloads/ikaros/output/桃乃木かな,涼美ほのか#

python 版本是 3.9.13 ，在alpinelinux系统上编译好后，直接在 OpenWRT 上运行的。

现在，就是无法确定是 python 的问题，还是 OpenWRT 系统的问题。我也在虚拟机上的 Rocky Linux 系统里试了一下，没有问题，可以正常处理这个路径。

任务完成，出错等，推送消息

指定网站与网址

[2024-01-06 20:45:35,355] ERROR in init: Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/flask/app.py", line 867, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/app.py", line 852, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/src/controller/main_ctrl.py", line 46, in previewRename
ret = rename.renamebyreg(content['source_folder'], content['reg'], content['prefix'], True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/src/bizlogic/rename.py", line 54, in renamebyreg
current_app.logger.debug(originep + " "+epresult)
~~~~~~~~~~~~~~~~^~~~~~~~~
TypeError: can only concatenate str (not "NoneType") to str

增加修改弹窗:

过滤:

1. topfolder输入框
2. secondfolder输入框

两个过滤条件，secondfolder为空则不过滤

修正:

1. topfolder修改框
2. secondfolder修改框

用 table 显示满足过滤条件内容

取消 table 内的 checkbox 框

增加 table 内单个文件的修改

自动化问题

我有两个目录存放不同的视频，想要设置下载之后自动刮削链接，刮削目录哪里我看说明，能配置多目录，用 ; 号隔开，我配置了多个不起作用，是不是是在刮削配置下只能配置一个刮削目录的原因?

现在只能，配一个刮削目录，此目录下载完自动刮削链接。
另一个目录只能配置下载完成转移，然后再在刮削配置中手动修改刮削！
能不能刮削目录也可以设置多对？

文件过滤

就是能刮削是能否对这些不需要的文件进行过滤，只刮削转移需要的文件？

刮削后文件路径显示问题

转移文件权限

转移后的文件权限是 root ，用户没办法操作

能否在 docker 中加入环境变量: PUID、PGID

胜者即是正义.S01.2012.全11集.1080p.日语.简体中字

S01.2012.11.1080p

如题，直接端口转发可以打开web，但是反代了就无法打开。。。有办法吗？

跨设备刮削转移文件遇到问题

最近更换了设备，开始玩 truenas，因为设置了单独的下载磁盘和存储磁盘分开的，所以在刮削任务里面设置了：刮削移动文件

在配置了 qbitterrent 下载完成自动任务，转移不成功，报错日志里面提示貌似还是用的链接模式，没有拷贝转移文件！

大佬能否看看哪里不对！

emby剧集刮削准确度低，获得准确的nfo信息会比较麻烦

定时清理源文件已经删除的转移文件，并刷新媒体服务器

注意：此操作与还原相冲突，默认关闭状态

识别文件的时候，第一个字母会识别不出来

检测到 Suwmlee/ikaros 一共引入了283个开源组件，存在9个漏洞

漏洞标题：handlebars 安全漏洞
缺陷组件：[email protected]
漏洞编号：CVE-2021-23369
漏洞描述：handlebars是一款语义化的Web模板系统。
handlebars 4.7.7版本之前存在安全漏洞，该漏洞源于在选择某些编译选项来编译来自不受信任的源的模板时，handlebars容易受到远程代码执行(Remote Code Execution, RCE)的攻击。
国家漏洞库信息：https://www.cnvd.org.cn/flaw/show/CNVD-2021-29741
影响范围：(∞, 4.7.7)
最小修复版本：4.7.7
缺陷组件引入路径：@->[email protected]>@semantic-release/[email protected]>[email protected]>[email protected]

另外还有9个漏洞，详细报告：https://mofeisec.com/jr?p=i99980

🚨 The automated release from the master branch failed. 🚨

I recommend you give this issue a high priority, so other packages depending on you can benefit from your bug fixes and new features again.

You can find below the list of errors reported by semantic-release. Each one of them has to be resolved in order to automatically publish your package. I’m sure you can fix this 💪.

Errors are usually caused by a misconfiguration or an authentication problem. With each error reported below you will find explanation and guidance to help you to resolve it.

Once all the errors are resolved, semantic-release will release your package the next time you push a commit to the master branch. You can also manually restart the failed CI job that runs semantic-release.

If you are not sure how to resolve this, here are some links that can help you:

• Usage documentation
• Frequently Asked Questions
• Support channels

If those don’t help, or if this issue is reporting something you think isn’t right, you can always ask the humans behind semantic-release.

Missing package.json file.

A package.json file at the root of your project is required to release on npm.

Please follow the npm guideline to create a valid package.json file.

Good luck with your project ✨

Your semantic-release bot 📦🚀

#11

如题，增加一下翻译功能吧，之前用mdc的时候是可以直接将标题翻译成中文的，用的是google的翻译

/app/src/utils/filehelper.py:273: SyntaxWarning: invalid escape sequence '('
for n in re.findall('([\（[)]\）]', base):
/app/src/utils/filehelper.py:275: SyntaxWarning: invalid escape sequence '('
cop = re.compile("[([\（]" + n + "[)]\）]")
/app/src/utils/filehelper.py:275: SyntaxWarning: invalid escape sequence ')'
cop = re.compile("[([\（]" + n + "[)]\）]")
/app/src/utils/regex.py:25: SyntaxWarning: invalid escape sequence '['
result = single.lstrip('第.EPep[ ')
/app/src/utils/regex.py:50: SyntaxWarning: invalid escape sequence '\d'
regx = "(?:s|season)(\d{2})"
/app/src/utils/regex.py:113: SyntaxWarning: invalid escape sequence '\d'
"第\d*[話话集]",
/app/src/utils/regex.py:114: SyntaxWarning: invalid escape sequence '('
"[ ]ep?[0-9.(videoa)][ ]",
/app/src/utils/regex.py:115: SyntaxWarning: invalid escape sequence '.'
".ep?[0-9(videoa)].",
/app/src/utils/regex.py:116: SyntaxWarning: invalid escape sequence '.'
".\d{2,3}(?:v\d)?[(videoa)].",
/app/src/utils/regex.py:117: SyntaxWarning: invalid escape sequence '\d'
"[ ]\d{2,3}(?:.\d|v\d)?[(videoa)][ ]",
/app/src/utils/regex.py:118: SyntaxWarning: invalid escape sequence '['
"[(?:e|ep)?[0-9.v]*(?:(oa)|(video))?]",
/app/src/utils/regex.py:128: SyntaxWarning: invalid escape sequence '\d'
regstr = "s(\d{1,2})ep?(\d{1,4})"
/app/src/utils/regex.py:155: SyntaxWarning: invalid escape sequence '\d'
regstr = "^(\d{1,3}) ?(_|-|.)? ?([^\W\d]+)"
/app/src/controller/optionctrl.py:73: SyntaxWarning: invalid escape sequence '\ '

install_matches = regexMatch(out, "INSTALLED:\ ([\d.]+)")
/app/src/controller/optionctrl.py:74: SyntaxWarning: invalid escape sequence '\ '

latest_matches = regexMatch(out, "LATEST:[\ ]+([\d.]+)")
/app/src/model/config.py:44: SyntaxWarning: invalid escape sequence '('
escape_literals = Column(String, default="()/")
/app/src/bizlogic/scraper.py:630: SyntaxWarning: invalid escape sequence '('
ext = re.sub('(.?)', '', s)
/app/src/utils/number_parser.py:6: SyntaxWarning: invalid escape sequence '\w'
"^\w+.(cc|com|net|me|club|jp|tv|xyz|biz|wiki|info|tw|us|de)@|^22-sht.me|"
/app/src/utils/number_parser.py:80: SyntaxWarning: invalid escape sequence '\d'
prog = re.compile("(?:-|)cd\d{1,2}", re.IGNORECASE | re.X | re.S)
/app/src/utils/number_parser.py:85: SyntaxWarning: invalid escape sequence '\d'
prog = re.compile("(?:-|)\d{1,2}$", re.IGNORECASE | re.X | re.S)
/app/src/utils/number_parser.py:122: SyntaxWarning: invalid escape sequence '['
filename = re.sub("[.?]","",filename)
/app/src/utils/number_parser.py:128: SyntaxWarning: invalid escape sequence '['
filename = str(re.sub("[\d{4}-\d{1,2}-\d{1,2}] - ", "", filename)) # 去除文件名中时间
/app/src/utils/number_parser.py:129: SyntaxWarning: invalid escape sequence '\d'
filename = re.sub("[-_]cd\d{1,2}", "", filename, flags=re.IGNORECASE)
/app/src/utils/number_parser.py:139: SyntaxWarning: invalid escape sequence '\d'
if re.search("\d+ch$", file_number, flags=re.I):
/app/src/bizlogic/transfer.py:347: SyntaxWarning: invalid escape sequence '\d'
tempmid = replaceRegex(tempmid, '^s(\d{2})-s(\d{2})')
[2024-01-02 12:58:43,622] INFO in init: Initialization: upgrade db
Traceback (most recent call last):
File "/usr/local/bin/flask", line 8, in
sys.exit(main())
^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 1064, in main
cli.main()
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/decorators.py", line 92, in new_func
return ctx.invoke(f, obj, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 912, in run_command
raise e from None
File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 898, in run_command
app = info.load_app()
^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 309, in load_app
app = locate_app(import_name, name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/flask/cli.py", line 219, in locate_app
import(module_name)
File "/app/app.py", line 4, in
application = create_app()
^^^^^^^^^^^^
File "/app/src/init.py", line 58, in create_app
schedulerService.start()
File "/app/src/service/schedulerservice.py", line 22, in start
self.scheduler.start()
File "/usr/local/lib/python3.12/site-packages/flask_apscheduler/scheduler.py", line 103, in start
self._scheduler.start(paused=paused)
File "/usr/local/lib/python3.12/site-packages/apscheduler/schedulers/background.py", line 38, in start
self._thread.start()
File "/usr/local/lib/python3.12/threading.py", line 971, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread

推荐使用telegram推送，可以自动获取链接的页面内容，无和谐