d6o / dsdownload Goto Github PK
View Code? Open in Web Editor NEWProgram and module for download queue optimization using multi-thread
Home Page: http://disiqueira.github.io/DSDownload
License: MIT License
Program and module for download queue optimization using multi-thread
Home Page: http://disiqueira.github.io/DSDownload
License: MIT License
I saw all examples use imgur, can I use these scripts to download from other sites or is it only for image downloads from imgur?
To confirm my suspicions I installed dsdownload
and tested it against Aria2 using a super simple CLI timer.
位 timer dsdownload http://wiki.alpinelinux.org/cgi-bin/dl.cgi/v3.3/releases/x86_64/alpine-3.3.1-x86_64.iso
[Worker 1] Downloading alpine-3.3.1-x86_64.iso
All files were downloaded.
Start: 21:34:09.76
End: 21:36:18.41
Total Time: 02:09.35 @ 0.6357 MB/s
位 timer aria2c -x5 http://wiki.alpinelinux.org/cgi-bin/dl.cgi/v3.3/releases/x86_64/alpine-3.3.1-x86_64.iso
01/27 21:38:52 [NOTICE] Allocating disk space. Use --file-allocation=none to disable it. See --file-allocation option in man page for more details.
[#bbc5d1 80MiB/82MiB(98%) CN:1 DL:5.6MiB]
01/27 21:39:07 [NOTICE] Download complete: D://alpine-3.3.1-x86_64.iso
Download Results:
gid |stat|avg speed |path/URI
======+====+===========+=======================================================
bbc5d1|OK | 5.6MiB/s|D://alpine-3.3.1-x86_64.iso
Status Legend:
(OK):download completed.
Start: 21:38:51.79
End: 21:39:07.17
Total Time: 00:56.62 @ 5.6MB/s
There seems to be considerable overhead when using your library vs any other mature download manager. I believe it's entirely misleading to advertise it as 400% faster when I could have downloaded this normally via browser faster than pulling it with 5 threads via Python let alone 8.8 times faster using Aria2.
This isn't a slam piece, I realize the potential when used programmatically, but I still think it's misleading.
Would it be possible to add Download stats? & non blocking
Windows 10, Python 3.5.
Traceback (most recent call last):
File "c:\python35\lib\runpy.py", line 170, in _run_module_as_main
"__main__", mod_spec)
File "c:\python35\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Python35\Scripts\dsdownload.exe\__main__.py", line 5, in
File "c:\python35\lib\site-packages\DSDownload\__init__.py", line 11, in
from DSDownload import DSDownload
File "c:\python35\lib\site-packages\DSDownload\DSDownload.py", line 15, in
import downloadthread
ImportError: No module named 'downloadthread'
In 1.4.1.0 all was fine.
Win7 Python3.5
Module Usage->example:
DSDownload(urls,
workers, output)
should be DSDownload.DSDownload(urls,
workers, output)
Or
Traceback (most recent call last):
File "C:\Users\Administrator\Desktop\TEST.PY", line 12, in
DSDownload(urls, workers,output)
TypeError: 'module' object is not callable
A declarative, efficient, and flexible JavaScript library for building user interfaces.
馃枛 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 馃搳馃搱馃帀
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google 鉂わ笍 Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.