Comments (1)
Hi, @GraphGrail ,
To use the pre-trained word embeddings from Polyglot in your project, you can download and load it using Polyglot's Embedding class. The following examples assume that you have installed Polyglot as mentioned in https://polyglot.readthedocs.org/en/latest/Installation.html
Taking English (whose language code is en
) as example, to download you may use the following Bash commands:
lang='en'
polyglot download embeddings2.${lang}
And to use it in your project, you may use the following Python snip:
from os import path
from polyglot.mapping import Embedding
lang = 'en'
home = path.expanduser('~')
emb = Embedding.load(path.join(home, 'polyglot_data/embeddings2/%s/embeddings_pkl.tar.bz2' % lang))
words = emb.words
vectors = emb.vectors
And now you can play with words
, which is a list of strings representing the vocabulary, and vectors
, which is a 2-d NumPy array whose i-th row (vectors[i]
) is the word embedding for the i-th word in words
.
from polyglot.
Related Issues (20)
- Download Problem
- word.morphemes returns "ValueError: Package 'morph2.da ' not found in index" when script is run, but works when run interactively HOT 1
- UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 4941: character maps to <undefined>
- ImportError: cannot import name 'SIGPIPE'
- Egregious detections
- Polyglot Morfessor Models HOT 1
- installation error HOT 3
- Status of the project? HOT 3
- pip install polyglot error: subproc exit with error:
- English to Japanese Transliteration
- translate English into Chinese
- Underscores make sentences detected as English?
- [1] 7092 segmentation fault python - Error is coming HOT 2
- polyglot download failing HOT 2
- Licensing issue for polyglot
- kbnblnejcfcvlkihlvjilrubllivlibecclvteugcjvb
- Missing settings for data path for collections
- word arabic detect false positive
- list of supported languages
- list of supported languages about Tokenization!why 165 Languages
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from polyglot.