Comments (2)
bdewilde
commented on July 29, 2024
1
Hi @mzeidhassan , thanks for submitting — definitely a bug! I'm not able to test against Windows, so this sort of error is hard for me to catch. The issue here is that textacy is opening the ConceptNet raw CSV file without a specified encoding, so falls back on the system's default. In macOS and Linux systems, the default "utf-8" decodes the data just fine; in Windows, I believe the default is CP1252, and it apparently doesn't recognize all these bytes.
I'm pretty sure that the solution is to add encoding="utf-8" to this line: https://github.com/chartbeat-labs/textacy/blob/main/src/textacy/resources/concept_net.py#L163. I'm going to push that commit to the develop branch, but again, I can't test against Windows. If you're able, please make the change on your local copy (or fetch textacy from the develop branch), then try again. Please let me know if it doesn't solve your issue!
from textacy.
mzeidhassan
commented on July 29, 2024
1
Hi @bdewilde and welcome back!
This was the fix indeed. I tested it and it works perfectly fine now.
Thanks for your support!
from textacy.
Related Issues (20)
- GHSL-2021-109 HOT 1
- ImportError: cannot import name 'keyterms' HOT 1
- Installing textacy on Python 3.6 downgrades the packages HOT 1
- Method to retrieve all words in ConceptNet HOT 1
- normalize_hyphenated_words() not working in version 0.11.0 HOT 1
- Can't Load Russian Language Model due to Caching Bug HOT 4
- Missing SVOTriple returned from subject_verb_object_triples(doc) ? HOT 1
- Missing ARM64 build on conda HOT 2
- most_discriminating_terms no longer available HOT 2
- Why `normalize.hyphenated_words` is not able to reassemble all words separated by a line break? HOT 2
- ERROR: Failed building wheel for pyemd during installation HOT 1
- Incompatible with NetworkX 3.0 HOT 6
- Updating triples.py to rely on spacy-wordnet and sense tagging
- vectorizer = TfidfVectorizer(tokenizer=createTokens) HOT 5
- readthedocs site still has 0.11.0 documentation HOT 2
- Improve quotation detection by parsing quotation mark types
- Quotes - Is there a way to include these additional patterns?
- to_bag_of_terms kwargs like to_bag_of_words
- YAKE favours single terms
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from textacy.