up209d / resourcessaverext Goto Github PK

Apologies as this probably is more or a feature request, but would find this to be loads useful on client side JS navigable pages where crawling doesn't seem to do the trick.

Is there a way to seamlessly aggregate all resources on a page and continue acquiring resources for each subsequent page where the user navigates? Such as, a start and then an end function, where then everything is zipped up into a single archive for full offline viewing.

Assuming that this doesn't exist and would be possible, could this feature be added in if it wouldn't be too much trouble for you?

Thanks in advance!

HI,

First of all thank you for providing a great tool..
When click on Save all resources button it downloads all the resources files of all domain from the current tab except few domains like ng://, webpack:// which are will available some times for angular/reactJS app.
[

](url

)
Please find the above screenshot for your reference where all tick marked resources are downloaded and "X" marked contents are not able to downloaded.

Please kindly check and do needful.

Hi I'm trying to download this web page http://www.coolmath-games.com/sites/cmatgame/files/public_games/22869/ but I display a blank page in the browser, it's possible process/render and download this web page with all resources and Canvas for offline viewing and playing HTML5 game? Thank you very much.

It would be nice to have options that permits users to skip files which already exist in destination folder or to overwrite existing ones.

Following elements will not be downloaded:

<audio id="zthlaudio_html5_api" 
class="vjs-tech" preload="none" 
src="/o/blob-download?blob=YmxvYi1xMU1TeDl3K09VcVkwRXBFSnRYb0l1SFdhSjJzSFMyVWxoQmJ5RFZJNG04PS1kNWQ2ZC1ZWFZrYVc4dmJYQmxadz09&amp;token=ZWpzZE9oa2FscmtSWkp0a0ZRbWNNWkdjQmVLSVM2UUIvcHM4UjBmOFRxND0*">

<source id="zthlaudio-source" 
src="/o/blob-download?blob=YmxvYi1xMU1TeDl3K09VcVkwRXBFSnRYb0l1SFdhSjJzSFMyVWxoQmJ5RFZJNG04PS1kNWQ2ZC1ZWFZrYVc4dmJYQmxadz09&amp;token=ZWpzZE9oa2FscmtSWkp0a0ZRbWNNWkdjQmVLSVM2UUIvcHM4UjBmOFRxND0*" type="audio/mpeg"> </audio>

Please see this example:

1. Browse here in Chrome https://getbootstrap.com/docs/4.0/examples/sticky-footer-navbar/

2. Open developer tools, click on ResourceSaver tab and click on "Save all resources"

3. get this locally (which looks very promising)

4. Open getbootstrap.com/getbootstrap.com/docs/4.0/examples/sticky-footer-navbar/index.html

I was expecting to see paths pointing to the local copies of assets, but instead the paths are to the remote assets.

I now have a local copy of jquery-3.2.1.slim.min.js because ResourcesSaverExt has helpfully downloaded it BUT the index.html file that references it is still pointing to the remote version of https://code.jquery.com/jquery-3.2.1.slim.min.js

is there a way to make the page we download be modified so that it points to the downloaded copies of all assets? (or am i missing something)?

Thanks in advance :)

Problem

When using this extension to retrieve my website https://polyapp.tech I encountered a problem with the downloaded images. The image URLs and other blobs on my website are very unusually formatted: https://polyapp.tech/blob/assets/AdvEblIPeH4YqkvzwwzM/Custom%20Computer%20Programming%20Services_Website%20Builder_vzIHXFJTaafUaotePCHFNZeDh_BodyBlobtgVDgEXakrysXdBB6uNuOzt47

When downloaded, this image is saved with an extension, ".jpg", and also the %20 characters are converted to spaces when saving the file.

Is this intended? I think this is a good thing since it makes the file easier to open on the destination computer and the file name easier to read.

Despite the benefits, there is now a problem when I transfer the file and try to serve it with a simple web server in Go:

package main

import (
	"net/http"
)

func main() {
	http.Handle("/", http.FileServer(http.Dir("./polyapp.tech")))
	http.ListenAndServe(":3500", nil)
}

Although most of the page loads, the images do not:

The problem is a mismatch in the easy to read file name which is downloaded by this extension and the HTML "src" attribute in the downloaded file which is still using the harder-to-read file name which does not contain the ".jpg" extension.

Suggested Solution

I would investigate and fix this issue in the code myself with a PR if #39 is resolved.

Hi sorry i'm not expert, downloaded this page http://www.coolmath-games.com/sites/cmatgame/files/public_games/22869/ with resources by XHR request but how to execute http-server? Possible add "file:///" in whitelist domains of core.js work offline? Thank you very much.

Not sure if it's some sort of overflowing buffer or it just needs to be throttled but if you have like 4000 assets on the site and some of which are large it will just crash

Tried this even on a fresh Chrome installation, whenever I try to download the packed files I get a network error, the download address being a blob contained within the extension URL. Not sure if the problem is on my browser or not. It used to not happen a few weeks ago!

I get issue when I try to download resources by closing chromes choose where to save feature. It doesnt downloads all the files and just stops downloading what should we do about that

Pretty Please?

I had to manually change the extension.

I see links like blob:https://4858444.org/eeecaa15-a249-579d-9d9a-a5b775d08bda. Сtrl+S doesn't work as the site uses PDFEmbedder-premium-secure.
The archive does not contain these files.
I can download them one at a time, but how do I download them all at once?

I've been trying to download a website that saves its javascript files without a file extension. As they're compressed into a zip, I cannot extract those files, I only run into errors.

Thank you

The plugin works well e.g. for ISpring Presentations.
Is there a way to automate further? e.g. download a list of urls for later offline use?

Even with XHR resources ticked, the resources specified with url() CSS function are missing in the downloaded archive.

Hi. I noticed that you informed users with error message when meet Chrome.runtime.error.

But I have problem with that because the filename of the download file is invalid.For example:
All Resources/test /.toDownload
Both the empty space after test and . at the first of the filename are invalid on the Mac.

Then the downloading process stopped which is what I won't expect to happen.
So would you like to add the feature to turn the invalid filename valid. I think it's easy to delete the invalid empty space character and the . character. And maybe some better method...

Would it be possible for me to make a modification so the downloaded zip file defaults to the cleaned up version of the URL (/(\|/|:|*|?|"|<|>||)/g,"_") it is being downloaded from? I tried
filename: 'All Resources/all.zip'tofilename: finalURI.zip`
but that didn't work. I'm not exactly shocked because I have no idea what I'm doing, but hey, I tried before annoying you :)

Thanks for a great extension!

Hello is there a way you can allow to add extensions to the resource file list ?

i want to download only a specific folder from the extension, can this be done?
also i installed version 1.9 from the unpacked folder but the manifest version is 2 and it will be outdated in 2023

Works fine on mac, but in Windows when the "compress" option is not checked the download hangs.

Great extension btw.

Hi,

How do i modify it in a way that it would just ignore folder structure and download all the files in one folder.

I am not sure if this is intended (as the checkbox is grayed out), but assuming it's not since it says "Recommended".

Or is it not possible to download just certain resources? Since I wouldn't want to download 1000+ files repeatedly.

Wow, I've been thoroughly searching for a complete html website downloader, and your repo is the closest thing I've seen. The simplicity, depth of files, and folder structure is incredible! Nice work!

Problem:
The downloaded html file is practically empty. I tried downloading it several times - same outcome. And there didn't seem to be a way to download only the html file. I saved the outer html from the developer tools, but the links are divorced from the downloaded resources. =(

Ideal outcome:
The html file downloaded would include the complete outer html, and updated links connected to the downloaded files and folder structure. That way, the local resources could load instantly.

Extra Information:
Awesome work! Also, not sure if that ideal outcome is your existing use case, but would love to know more about your intended use, as well as, future direction of this repo! =]

I'd like to modify this extension to help me clone entire websites and republish it under a different name since the use-case of such a cloning will be different. Unfortunately I don't see a license so I'm not legally allowed to do that. Could you add a permissive software license like MIT to this repository please?

Hi!

Vivaldy is full compatible chromium browser for any extantions what i use
but this not work :(

when i press Save All resources. nothing happend

ps: i test it in Chrome, all work fine, but i not use Chrome

Thanks

When I download resources, the page js file will always be warned, how to solve? My Google Chrome version is 63.0.3239.84

Hi i'm download this web page https://kiwiirc.com/client but i display blank page in browser with errors. It's possible download this dynamic web page at current state and view correctly in browser? Thank you very much.

With XHR requests that get data with query strings your extension seems to only save the first request and ignore all the ones that follow. It would be useful if all of the results are being saved, either with the query strings in the file name or with the date and time of the request or some consecutive numbering.

First of all thanks for developing & sharing this useful extension to make our lives easy. 👍

If start & stop capturing could be added, it would be more useful for us. For example, I've started capturing from one page and then navigate to another page & then another..... within same site. And when I'm done visiting all the required pages in a website, I could stop capturing and the download all the recorded files in a single zip file.

I hope, you will find this feature request useful and implement it soon.

Thanks again for this awesome tool.

Version: 0.1.8

Example pages:

https://interactive-examples.mdn.mozilla.net/pages/tabbed/audio.html
https://interactive-examples.mdn.mozilla.net/pages/tabbed/video.html

Steps to reproduce:

Open the links above.
Open Devtools and switch to ResourcesSaver tab.
Check "Include all assets by XHR requests (require page reload)."
Play the audio/video.
Switch back to ResourcesSaver and click save all resources.
Find and extract t-rex-roar.mp3 and flower.webm respectively in the zip file.
Download these files using browser's builtin download function.
Compare the files.

Expected behavior:

Files saved using ResourcesSaver are identical to files downloaded using browser's builtin download function.

Actual behavior:

For t-rex-roar.mp3, only a small part is saved. For flower.webm, file cannot be played.

Probably due to the devtool updates:

https://developers.google.com/web/updates/2020/03/devtools

Currently, many users are facing such issues that the output file is rendered in txt format instead of zip, I will try to figure out the bug(s) other collaborators should too.

Has any way or any api to call for downloading files programmatically?

I need it for using in selenium.

Thank you very much for this extension, it is very useful, but there is a problem,

Can you add an option to download CSS files only?
Because don't care about other files, just want to download CSS files, but I can't find this option, After each download, there are a lot of unrelated other files.

It would be awesome if you can port this extension to Firefox Quantum.

I want to download the contents of the "src" folder inside "." but it doesn't find it. Maybe because of the strange folder name? (See attachments.)

Edit: I realized that the "src" and the "node-modules" folders are downloaded into the root folder (as the "." gets ignored I guess), but the other "src" folder, which was originally there, overwrites all the contents in it.

Edit 2: After modding the extension, it worked perfectly. It would be nice to have a setting to enable or disable file overwrites. Or even better - let users create a white list (in the form of a regex expression) to filter which paths and files to download.

What I need:

What I get:

Hi, it's possible download all resources + by XHR Request on single html file? Thank you very much and this feature can be added in this extension?

from this site http://preview.themeforest.net/item/adventure-tours-wordpress-tourtravel-theme/full_screen_preview/12781942?_ga=2.259441864.352627645.1599299052-828512567.1599211047&_gac=1.217367074.1599299052.EAIaIQobChMIhfCzsJXP6wIVU_hRCh1wAQV6EAAYASAAEgIII_D_BwE
i cant download the images from there, all ignored

it would be great if you add that option from http://preview.themeforest.net + theme and not this link exactly

i can find the images on the network tab

I have a page that has a video (mp4) running in background, while using the extension it looks like the file gets corrupted

When using ResourcesSaver to download a page, images that are referenced in onMouseOver/onMouseOut are not downloaded to the local machine.

For example:
<img title="Hello" src="/ico/view.png" onmouseover="this.src='/ico/view.hover.png'" onmouseout="this.src='/ico/view.png'" />

The /ico/view.png is downloaded, however the /ico/view.hover.png file isn't. Is there a setting where we can specify to grab these images?

many thanks

It fetches the files and It starts the download but download fails.
May i know whats the issue here?

• Compress all assets & download at once (Recommended)

I unchecked this option because of a specific case I have. but if I come again, I find it checked.

I think it would be nice, if your chrome extension can remember user last settings

The extension worked very well, but when there is a file with a special character like "ç" it seems to break.

The site has a file whose name is: "53_Jean_Goçalves".
And when I use the extension it saves it with the following name: "53_Jean_Go% C3% A7alves".

Maybe there's a way to use Unicode to save file's name.

it's possible provide a button on the webpage ? or when i click extension icon it can download automatic?