Comments (6)
The 'Memory Quota Exceeded' could be due to the fact that we are buffering the entire objects into memory, and with a ton of images being generated, this would add up quickly - not sure if something like this would help: aws/aws-sdk-js#656
from image-resizer.
A few thoughts here:
- are you running behind a CDN? much of the premise of this app is lost when no CDN is used.
- from the logs it looks like you are using a 1X dyno which may not be sufficient if your source images are very large.
- so very early on the code was attempting to stream objects as opposed to buffering them to memory but it turned out that
gm
was simply buffering them anyway and sharp may do something similar as some of the operations require all of the image to be used.
It is possible there could be a memory leak in the code, but my first guess is that you are asking the simple dyno to do too much work. Try scaling to a 2X and see if things improve, but as I said it is fairly dependant on your source images.
from image-resizer.
Scaling it to 2X did seem stop memory leaks. The app does climb to about 700MB of memory usage but doesn't seem to go above that.
from image-resizer.
Hello, you may want to reduce the size of libvips' operation cache on memory-constrained systems - see http://sharp.dimens.io/en/stable/api/#sharpcachememory-items
from image-resizer.
@lovell, thanks again for the input.
@J-Gonzalez if you can give this a go I would love to hear the results. image-resizer
is designed to have the most sensible defaults for most cases and it sounds like setting appropriate cache sizes should be one of them.
from image-resizer.
Closing due to inactivity.
from image-resizer.
Related Issues (20)
- Black background when converting png to jpg HOT 1
- Using it for s3 compatible third party buckets (but not provided by amazon) HOT 1
- app crashes on jpg image HOT 11
- Please add additional logging when using EXTERNAL_SOURCE_* HOT 1
- Unable to disable Chalk coloured output HOT 2
- Update sharp dependency to v0.12.0 HOT 3
- How to run it in production mode on AWS HOT 3
- Installation Error HOT 5
- 'The specified key does not exist.' error when used behind Nginx. HOT 2
- 'The specified key does not exist.' when accessing image 3 folders deep. HOT 2
- crashes when empty input HOT 1
- Is this project dead? HOT 2
- Random error HOT 2
- Is this repo dead? HOT 1
- Image Quality HOT 1
- Use of lovell/sharp/master/preinstall.sh is deprecated, will be removed at end of 2016 HOT 1
- High severity vulnerability affecting this repo
- Can't make a route other than root '/' HOT 2
- looks lossy HOT 5
- Does not work with proxy
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from image-resizer.