Html file empty about resourcessaverext HOT 6 CLOSED

@captaindavepdx Hey mate, thank for using the ext, I thought that I fixed this issue, could you provide the version you are using? 0.1.8? It is a little bit hard to debug without a real test case. But here is the thing that I downloaded from Donald Trump Twitter, I think the HTML file is pretty fine.

from resourcessaverext.

@up209d, Hey man, thanks for the quick reply. Yes, I'm using version 0.1.8. I forgot to mention that I'm calling a custom script to scroll to the absolute bottom of the page. Could that make the difference?

• scrollHeight could be 400,000+
• staticResources could be a few thousand

var start = false;
var running = false;
var lastScrollY = 0;

function scroll(retryAttempt) {
    
    if (running == false && retryAttempt < 10) {
        running = true;
        
        window.scrollBy(0, 500);
        
        if (window.scrollY != lastScrollY) {
            lastScrollY = window.scrollY;
            window.scrollBy(0, 1000);
            setTimeout(function() {
                       running = false;
                       scroll(0);
                       }, 1000);
        } else {
            setTimeout(function() {
                       running = false;
                       scroll(retryAttempt + 1)
                       }, 1000);
        }
    } else {
        postMessage();
        return;
    }
}

if (start == false) {
    start = true;
    scroll(0);
}

Update:
I tested UP without any custom scripts, and the html file downloaded successfully. Again, great work!

• When viewed, the layout looked identical to the original site.
• The links were separate from the downloaded folder structure.

• Added a base url <base href="http://twitter.com/">. The links worked, but it didn't utilize your awesome downloaded resources.

• The images appeared to load from the original source, instead of the downloaded folder structure.

• The embedded videos displayed an error message when clicked

Question:
Is it possible to link the html file to your downloaded resources? Including videos?

from resourcessaverext.

@captaindavepdx Ah I got what you mean now, it is more complicated to do that. That’s why I defined the extension is a downloading resources tool but not the website downloading tool. Its purpose is naive and simple that get everything from the source 1 to 1 greedily without any modification. Cooking the html content to serve everything locally is much harder than what the extension is capable for at the moment. Maybe you can try to create http-server on the local folders and map the localhost to the desired domain eg twitter.com. But again it is not quite a sweet solution.

from resourcessaverext.

Right on, good to know, thanks @up209d!

Would an html file with a large scrollHeight still be within the scope of your extension?

Update:
I've started to piece together a website downloader. If I figure out a simple way to connect the links, I'll post the solution. I think it'd be awesome if your extension could all of that!

from resourcessaverext.

@captaindavepdx In term of a long scrollHeight, I think you are doing correctly, because all assets downloading are triggered by browser itself, so we have to scroll down to make sure browser can load those hidden assets.

from resourcessaverext.

@up209d Right on, I'll post progress updates regarding the connected links. If you have any suggestions, let me know.

from resourcessaverext.