renyijiu / douyin_downloader Goto Github PK

这个人的主页第一条视频就是这样
http://v.douyin.com/Pqgn6Q/
视频是这个
http://v.douyin.com/Pqbf7r/

原视频有几分钟，下载的只有18秒

I only got response: get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}

不知道写的啥，不认真。 看不懂是我水平低了

get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 116, in get_list_by_uid
res_json = json.loads(r.html.text)
File "/usr/lib64/python3.6/json/init.py", line 354, in loads
return _default_decoder.decode(s)
File "/usr/lib64/python3.6/json/decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib64/python3.6/json/decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

1. python douyin.py --urls="http://v.douyin.com/moUEXM/"
2. terminal中打印出

(douyin_env) F:\工作 2\一>python douyin.py --urls="http://v.douyin.com/moUEXM/"
Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 95, in get_list_by_uid
signature = FREEZE_SIGNATURE if FREEZE_SIGNATURE else get_signature(user_id)
File "douyin.py", line 70, in get_signature
r.html.render()
File "F:\工作 2\一\douyin_env\lib\site-packages\requests_html.py", line 654, in html
self._html = HTML(session=self.session, url=self.url, html=self.content, default_encoding=self.encoding)
File "F:\工作 2\一\douyin_env\lib\site-packages\requests_html.py", line 421, in init
element=PyQuery(html)('html') or PyQuery(f'{html}')('html'),
File "F:\工作 2一\douyin_env\lib\site-packages\pyquery\pyquery.py", line 266, in init
raise TypeError(context)
TypeError: None

3. python douyin.py -s -u 分享短链接/长链接 可以下载单个视频的

When I use the scripts python douyin.py --url=https://v.douyin.com/JRoydED/, I jsut encountered the problem following
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='storage.googleapis.com', port=443): Max retries exceeded with url: /chromium-browser-snapshots/Mac/575458/chrome-mac.zip (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])"))). I don't know how to solve it.

通过分享链接，如何能做到去水印呢？我看渲染出来的video标签内的链接并没有水印的参数，是在那步修改的url呢？

Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 95, in get_list_by_uid
signature = FREEZE_SIGNATURE if FREEZE_SIGNATURE else get_signature(user_id)
File "douyin.py", line 70, in get_signature
r.html.render()
File "D:\Python\Python36\lib\site-packages\requests_html.py", line 654, in html
self._html = HTML(session=self.session, url=self.url, html=self.content, default_encoding=self.encoding)
File "D:\Python\Python36\lib\site-packages\requests_html.py", line 421, in init
element=PyQuery(html)('html') or PyQuery(f'{html}')('html'),
File "D:\Python\Python36\lib\site-packages\pyquery\pyquery.py", line 266, in init
raise TypeError(context)
TypeError: None
他提到的requests_html和pyquery我重新卸载安装过，问题依旧，是哪出问题了？

Traceback (most recent call last):
File "douyin.py", line 11, in
from requests_html import HTMLSession
File "C:\Python\lib\site-packages\requests_html.py", line 9, in
import pyppeteer
File "C:\Python\lib\site-packages\pyppeteer_init_.py", line 30, in
from pyppeteer.launcher import connect, launch, executablePath # noqa: E402
File "C:\Python\lib\site-packages\pyppeteer\launcher.py", line 24, in
from pyppeteer.browser import Browser
File "C:\Python\lib\site-packages\pyppeteer\browser.py", line 13, in
from pyppeteer.connection import Connection
File "C:\Python\lib\site-packages\pyppeteer\connection.py", line 12, in
import websockets
File "C:\Python\lib\site-packages\websockets_init_.py", line 3, in
from .auth import *
File "C:\Python\lib\site-packages\websockets\auth.py", line 15, in
from .server import HTTPResponse, WebSocketServerProtocol
File "C:\Python\lib\site-packages\websockets\server.py", line 49, in
from .protocol import WebSocketCommonProtocol
File "C:\Python\lib\site-packages\websockets\protocol.py", line 18, in
from typing import (
ImportError: cannot import name 'Deque'

Traceback (most recent call last):
File "douyin.py", line 574, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 370, in init
self.scheduling(favorite)
File "douyin.py", line 379, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 396, in download_user_videos
uid, dytk = get_user_info(user_id)
File "douyin.py", line 78, in get_user_info
uid = r.html.search('uid: "{uid}"')['uid']
TypeError: 'NoneType' object is not subscriptable

get empty list, {'has_more': 1, 'status_code': 0, 'min_cursor': 0, 'aweme_list': []}
retry...

why i got itemId = 0 and, uid =0, i get douyin link in vietnam

here the link:

https://v.douyin.com/cTgexD/

我在里面添加了链接，但是下载的时候什么都没有

目前从HTML解析出来类似这样：https://aweme.snssdk.com/aweme/v1/playwm/?s_vid=93f1b41336a8b7a442dbf1c29c6bbc563cee1a2ae9eee323b4f0155dba57fdd61ae2c983b1893ec7074426e7c178662f668166c7cfb860c615ca576132238e0b&line=0

这个链接的怎么替换才是无水印的视频链接