Comments (21)
from echo360.
Sorry. Should be public now.
from echo360.
Does this link lead to the video content?
https://content.echo360.org/0000.18ff41c7-5a40-4929-bb90-3b3ee5e64ffb/633b2de6-6841-4135-a2c5-b525ea7c0992/1/s1_av.m3u8
from echo360.
I don't think so. If I load that url, chrome downloads the m3u8 file if I am logged in to echo360. In a text editor, the m3u8 file looks like this:
#EXTM3U
#EXT-X-VERSION:7
#EXT-X-INDEPENDENT-SEGMENTS
#EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="q0",NAME="Default",DEFAULT=YES,AUTOSELECT=YES,URI="s0q0.m3u8"
#EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="q1",NAME="Default",DEFAULT=YES,AUTOSELECT=YES,URI="s0q1.m3u8"
#EXT-X-STREAM-INF:BANDWIDTH=55528,RESOLUTION=640x360,PROGRAM-ID=1,AUDIO="q0",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0
s1q0.m3u8
#EXT-X-STREAM-INF:BANDWIDTH=220997,RESOLUTION=1920x1080,PROGRAM-ID=1,AUDIO="q1",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0
s1q1.m3u8
If I use the --interactive flag and try to download just one lecture, same result as the debug:
continue
>> I'm gonna assume you are responsible enough to had finished logged in by now ;)
>> Retrieving echo360 Course Info... 1/1 videos Done!
============================================================
Course: [[UNTITLED]]
Total videos to download: 1 out of 1
============================================================
------------------------------------------------------------
Downloading "2021-05-06 - Lecture 1.3"
ERROR: Failed to find audio/video m3u8... skipping this one
=================================================================
Course: [[UNTITLED]]
=================================================================
Successfully downloaded:
=================================================================
C:\echo>
from echo360.
So, the one thing that is different with the courses that are not working versus the course that is working is the non-working courses have a subfolder as shown in this screenshot: https://i.imgur.com/IGENonx.jpg
Does that help any?
from echo360.
Hi, I am having the same issue. It gives the error for any video uploaded after April 20th/21st.
from echo360.
Hi @bwhurd and @getBoolean I've pushed a new commit attempting to fix it based purely on the logs. Can you see if it did the trick?
from echo360.
Hi @bwhurd and @getBoolean I've pushed a new commit attempting to fix it based purely on the logs. Can you see if it did the trick?
I would test it but I can't log in to echo360 anymore. It just says "Identity provider was not found". I think this is on echo360/ my school's side.
from echo360.
Hi @bwhurd and @getBoolean I've pushed a new commit attempting to fix it based purely on the logs. Can you see if it did the trick?
This definitely improved matters for me - it got as far as downloading a video, for the first time, but then errored out converting the video:
DEBUG: Found the following urls [u'https://content.echo360.org.au/0000.00c445c8-03e2-41c4-b11c-c2fa22eea211/a9978b47-7f32-4dcb-91b2-8c23e26b2a81/1/s1_av.m3u8']
>> Retrieving echo360 Course Info... 6/6 videos Done!
============================================================
Course: [[UNTITLED]]
Total videos to download: 6 out of 6
============================================================
------------------------------------------------------------
Downloading "2021-05-12 - Lecture 6 [Summary and review includng review of homework exercises]"
DEBUG: GET http://127.0.0.1:60555/session/985aee85d987ecf9441b5e3e2c07147e/cookie {"sessionId": "985aee85d987ecf9441b5e3e2c07147e"}
DEBUG: http://127.0.0.1:60555 "GET /session/985aee85d987ecf9441b5e3e2c07147e/cookie HTTP/1.1" 200 2357
DEBUG: Finished Request
- Downloading video feed 1...
DEBUG: Starting new HTTPS connection (1): content.echo360.org.au:443
DEBUG: https://content.echo360.org.au:443 "GET /0000.00c445c8-03e2-41c4-b11c-c2fa22eea211/a9978b47-7f32-4dcb-91b2-8c23e26b2a81/1/s1_av.m3u8 HTTP/1.1" 200 518
DEBUG: Searching for m3u8 with content [u'#EXTM3U', u'#EXT-X-VERSION:7', u'#EXT-X-INDEPENDENT-SEGMENTS', u'', u'#EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="q0",NAME="Default",DEFAULT=YES,AUTOSELECT=YES,URI="s0q0.m3u8"', u'#EXT-X-MEDIA:TYPE=AUDIO,GROUP-ID="q1",NAME="Default",DEFAULT=YES,AUTOSELECT=YES,URI="s0q1.m3u8"', u'', u'#EXT-X-STREAM-INF:BANDWIDTH=55000,RESOLUTION=640x360,PROGRAM-ID=1,AUDIO="q0",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0', u's1q0.m3u8', u'#EXT-X-STREAM-INF:BANDWIDTH=220055,RESOLUTION=1920x1080,PROGRAM-ID=1,AUDIO="q1",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0', u's1q1.m3u8', u'']
DEBUG: Found video with line s1q0.m3u8 with prev line #EXT-X-STREAM-INF:BANDWIDTH=55000,RESOLUTION=640x360,PROGRAM-ID=1,AUDIO="q0",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0
DEBUG: Found video with line s1q1.m3u8 with prev line #EXT-X-STREAM-INF:BANDWIDTH=220055,RESOLUTION=1920x1080,PROGRAM-ID=1,AUDIO="q1",CODECS="avc1.640029,mp4a.40.2",FRAME-RATE=25.0
> Downloading video:
DEBUG: GET http://127.0.0.1:60555/session/985aee85d987ecf9441b5e3e2c07147e/cookie {"sessionId": "985aee85d987ecf9441b5e3e2c07147e"}
DEBUG: http://127.0.0.1:60555 "GET /session/985aee85d987ecf9441b5e3e2c07147e/cookie HTTP/1.1" 200 2357
DEBUG: Finished Request
DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG: Starting new HTTPS connection (1): content.echo360.org.au:443
DEBUG: https://content.echo360.org.au:443 "GET /0000.00c445c8-03e2-41c4-b11c-c2fa22eea211/a9978b47-7f32-4dcb-91b2-8c23e26b2a81/1/s1q1.m3u8 HTTP/1.1" 200 None
> Progress: [> ] 0.00% 0/1DEBUG: https://content.echo360.org.au:443 "GET /0000.00c445c8-03e2-41c4-b11c-c2fa22eea211/a9978b47-7f32-4dcb-91b2-8c23e26b2a81/1/s1q1.m4s HTTP/1.1" 200 172744399
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 173M/173M [00:34<00:00, 4.98MiB/s]
> Converting to mp4... Traceback (most recent call last):
File "echo360.py", line 7, in <module>
sys.exit(main())
File "/Users/damian/Downloads/echo360-master/echo360/main.py", line 356, in main
downloader.download_all()
File "/Users/damian/Downloads/echo360-master/echo360/downloader.py", line 235, in download_all
if video.download(self._output_dir, filename):
File "/Users/damian/Downloads/echo360-master/echo360/videos.py", line 268, in download
result = self.download_single(session, single_url, output_dir, new_filename, pool_size)
File "/Users/damian/Downloads/echo360-master/echo360/videos.py", line 331, in download_single
os.rename(video_file, final_file)
NameError: global name 'final_file' is not defined
I should add that I simply downloaded the current master and ran it unmodified. This is my command line:
python echo360.py https://echo360.org.au/section/1d351654-a234-4dba-9bb7-31b606f2d4af/home --output Lectures --alternative_feeds --debug
I've tried with and without alternative feeds, and also using the run.sh script instead of python echo360.py
. All with the same error at the end.
from echo360.
it downloaded only the first video, then failed to convert it and terminated. Here is the debug. Really appreciate it!
EDIT: actually, this debug is cleaner. the first one had some files leftover in the output folder causing conflicts.
from echo360.
Give the latest commit another go? Also let me know if the audio/video track of the resulting file seems fine.
from echo360.
Huge step forward - with the latest commit, successfully downloaded and converted all 6 videos to playable mp4 videos. However, none of them have any audio. I've tried with and without --alternative_feeds
.
Debug log is here: https://gist.github.com/drdm/eedd12dc05fff4121eaf8cc116f4f490
BTW, the echo360 utility is awesome, and your time in updating it for whatever change in Echo360 broke it is much appreciated. Thank you!
from echo360.
Thanks @drdm for your kind words. I actually don't have the needs to use this tools for like 3 years now (nor the access to), so mostly I've just been coping to fix any breaking upstream updates.
I think the posted debug log are not full? I need the log of the downloading process (as it seems like it fails to discover audio stream). If you are concern with privacy issue feel free to email me the log instead.
from echo360.
@soraxas is this the log you need? https://gist.github.com/drdm/6ed07b91055925c5f86e059d0c0939cd
from echo360.
Feel free to test the latest push.
from echo360.
@soraxas you're a genius :)
That's pretty quick going for a new (modified) parser. Works perfectly.
Thanks!
from echo360.
Great that it works!
from echo360.
Hi there soraxas-- so, now the downloader works if I download all of the videos, so thank you!
However, the --interactive flag broke with the latest commits. Yesterday, when the videos would not download, the --interactive flag was working even though the videos would not download. (meaning, the list of lectures would appear, and I could select them)
Here's the debug for the latest commit when it terminates after parsing with the interactive flag before downloading begins.
from echo360.
Here is a debug of a successful download of all of the files using the latest commit if that helps.
from echo360.
Hi @bwhurd I cannot reproduce what you had mentioned as the --interactive
flag was not affected from my end. What do you mean by it's broke? I also couldn't find any anything wrong with the log. Did it hangs (the log stopped somewhere there)? Was it because of your netowrk issue?
The commit shouldn't have touched anything that is related to the interactive flag functionality.
from echo360.
I think I was wrong and --interactive is working for me. Issue closed. Thank you!
from echo360.
Related Issues (20)
- Automated Windows downloading fails HOT 3
- Work around for authentication issue HOT 1
- ffmpeg not found error HOT 3
- lecture name [[UNTITLED]], content with in its folder keeps cleaned and overrided by newer downloaded video HOT 7
- Unable to download for Canadian Echo360 HOT 2
- --after-date and --before-date don't work HOT 4
- Chrome driver fails to launch Chrome HOT 1
- After downloading the files, they get deleted. Result is empty download folder. HOT 3
- echo360.py cant find the video as there is no home page for it HOT 6
- Failed to get m3u8 info for EchoCourse! HOT 2
- PHANTOMJS removed in selenium v4 HOT 3
- Doesn't work for UNSW HOT 2
- Ways to download single media file HOT 1
- Missing or invalid capabilities in selenium HOT 6
- Outdated chromedriver HOT 4
- how to download public video HOT 1
- SSL Error HOT 2
- chromedriver for M1 mac? HOT 7
- transcript download? HOT 4
- Bump selenium to 4.16.0. HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from echo360.