Comments (4)
MartinBernstorff
commented on May 18, 2024
1
Okay, I've been doing some digging! I've been unable to find any component that dramatically improves runtime.
Attached is my profiling script and its profile from cProfile: https://www.dropbox.com/sh/s60k7894ufva5vf/AADSpcN5OaDkg5rFDIPAAdLwa?dl=0
I recommend snakeviz for visualisation 👍
Let me know if there's anything I can add!
from textdescriptives.
HLasse
commented on May 18, 2024
A job for you, @martbern ?
from textdescriptives.
MartinBernstorff
commented on May 18, 2024
Very well might be! Have quite a few open loops atm – what's the priority on this?
from textdescriptives.
HLasse
commented on May 18, 2024
Profiling has fairly high priority - if pos-stats really slows things down as much as i fear, then it should be removed from the default TextDescriptives pipe pretty soon. Optimizing it is not a huge priority atm
from textdescriptives.
Related Issues (20)
- Add proportion of word in vocabuary
- Add Unigram entropy
- How is `doc_length` different from other length measures such as `n_characters`? HOT 3
- Ensure component consistency HOT 4
- Quick start not working as expected HOT 4
- Quickstart broke on Spacy example HOT 1
- Issue with tests HOT 1
- Failing test HOT 5
- Demos / Browser-Based Usage HOT 34
- Fails for empty strings HOT 4
- Support transformer models
- Pyphen does not support all languages that spaCy does HOT 2
- Listed metrics deviate between extraction functions in docs HOT 7
- References for readability metrics HOT 4
- Croatian language requires `lexeme_prob` table HOT 6
- Different readability scores between textdescriptives and textstat HOT 3
- Readability documentation is wrongly formatted
- Migrate to swift CI template HOT 4
- Not all pos_proportions output HOT 3
- docs: fix documentation building following pydantic_autodoc v2.0 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from textdescriptives.