Janome is a Japanese morphological analysis engine written in pure Python.
General documentation:
http://mocobeta.github.io/janome/en/ (English)
http://mocobeta.github.io/janome/ (Japanese)
Python 2.7.x or 3.3+ is required.
[Note] This consumes about 500 MB memory for building.
(venv) $ python setup.py install
(env) $ python
>>> from janome.tokenizer import Tokenizer
>>> t = Tokenizer()
>>> for token in t.tokenize(u'すもももももももものうち'):
... print(token)
...
すもも 名詞,一般,*,*,*,*,すもも,スモモ,スモモ
も 助詞,係助詞,*,*,*,*,も,モ,モ
もも 名詞,一般,*,*,*,*,もも,モモ,モモ
も 助詞,係助詞,*,*,*,*,も,モ,モ
もも 名詞,一般,*,*,*,*,もも,モモ,モモ
の 助詞,連体化,*,*,*,*,の,ノ,ノ
うち 名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ
Licensed under Apache License 2.0 and uses the MeCab-IPADIC dictionary/statistical model.
See LICENSE.txt and NOTICE.txt for license details.
Special thanks to @ikawaha and @takuya_a.
Copyright(C) 2015, moco_beta. All rights reserved.