Comments (4)
I should also mention that I'm not 100% sure the errors I was getting today were memory-related, but they went away when I increased memory allocation.
Either way, it seems that on our current trajectory, we will eventually reach a point where machines equipped with 16GB will be unable to run the demo locally via docker.
from allennlp-demo.
@aaronsarnat if you need a short term fix for this, you can modify this line here to only load the relevant model. E.g when I was developing the dependency parser demo, I would add:
for name, demo_model in MODELS.items():
if name != "dependency-parser":
continue
logger.info(f"loading {name} model")
predictor = demo_model.predictor()
app.predictors[name] = predictor
This causes only the relevant model to be loaded, meaning that 1) it's faster and 2) it takes way less memory.
You can see the keys for the models here.
from allennlp-demo.
@DeNeutoy thanks for the follow-up. I will definitely try this if I run into any memory blockers.
I suppose another solution is we each get one of these:
from allennlp-demo.
We added better support for running a subset of the models.
from allennlp-demo.
Related Issues (20)
- Textual Entailment model is broken due to a javascript error HOT 1
- Payload too large error (http 413) when submitting the VQA demo. HOT 5
- Unexpected token < in JSON at position 0 HOT 5
- In house SEQ explorer application/website
- [Constituency Parsing] Long sentences aren't properly rendered in screen HOT 1
- The demo deploy doesn't work. HOT 2
- Adding a pretrained model outside of AllenNLP to the AllenNLP_demo HOT 1
- New to AllenNLP. Trying to start the Demo. HOT 4
- Emphasize that the AllenNLP library is losing support in December on allenai.org/allennlp. HOT 7
- Error when starting bidaf
- text-to-sql demo is no longer available
- TaskDemo should simply by named "Demo"
- Modify the API endpoints so that they all get their own certificate.
- README.md header doesn't show well in dark mode
- Rename main branch to "main"
- Selecting a model doesn't work anymore. HOT 1
- The demo script isn't working anymore.
- Add SmBoP to demo HOT 3
- Update Sentry and Filter Spurious Errors HOT 2
- NPM Security Alerts: Patch AllenNLP Demo
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from allennlp-demo.