Comments (3)
Hello, I'd like to work on this.
What do you have in mind?
I am thinking of using a HashMap<String, String>
in http.rs
to index response.text()
by response.url()
.
from monolith.
Hey there @voila!
Your help would be greatly appreciated on this one. Sounds like using hashmap is going to do the job. During its first prototype I used an object (it was initially written in JS), so I guess great minds think alike? Using strings for storing base64 sounds good to me. It could be cool to borrow dataURLs from that "store" to minimize the RAM footprint, but that perhaps should be a later enhancement. We could set it to cache only binary data, or, perhaps selecting what to cache and what not to cache by looking at the mime-type (e.g. always store base64 of png/svg/gif, never cache JS or CSS since it's unlikely those will ever get included more than once). 404's don't need to be cached I think, we just need to replace links to broken resources with full URLs.
If you could help implementing caching that would be of great help for everyone who uses monolith. We could always improve what and how it caches later, saving time on not making redundant requests is the most important objective right now.
from monolith.
Resolved by #75 thanks to @voila
from monolith.
Related Issues (20)
- Asynchronous execution error
- How to extract files in html HOT 2
- feature request : Rate-limiting CLI option HOT 3
- macOS release binary ? HOT 2
- Not able to full download a webpage HOT 2
- Unsupported document media type HOT 2
- XHTML documents get mangled
- Save pages with login HOT 2
- Query: Can monolith recursively follow links in a single domain and create a monolith for them ? HOT 3
- Can you create an option to remove links, buttons and input boxes? HOT 3
- Thank you HOT 1
- What does the -I flag do? HOT 2
- Suggestion: add bot indicator flag
- Scraping from archives feature
- Monolith cannot save 404 pages HOT 1
- Image not saved correctly
- error while loading shared libraries HOT 1
- Saved page is about blocked cookies HOT 2
- Build warnings HOT 4
- Error following redirect for url HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from monolith.