erickguan / cppjieba_rb Goto Github PK

cppjieba_rb is a dependency of Discourse, which I am trying to get to run on JRuby. However, JRuby does not support CRuby extensions.

There is a Java library (https://github.com/huaban/jieba-analysis) that could be used from JRuby to provide the same functionality (or at least, I think so...I am not familiar with the jieba library and English documentation online is rather sparse).

Perhaps we can work together to get a jieba library for Ruby that works with both the native extension and the JVM library?

Looks like internal.cc has a reference to it. So this is broken with latest prerelease Ruby.

ster worker 0: 8644 [discourse]: ../cppjieba/include/cppjieba/Trie.hpp:150: void cppjieba::Trie::CreateTrie(const std::vector >&, const std::vector&): Assertion `keys.size() == valuePointers.size()' failed.

What does this mean?

I saw lots of such messages in puma.err.log.

And every time I post in Chinese, it will trigger one such message

discourse version 2.2.0.beta2~git106.a530606da7

cppjieba_rb version 0.3.0