Problem with handling encoding failure about bilm-tf HOT 6 CLOSED

@qujinqiang This blog may be helpful for you. http://www.linzehui.me/2018/08/12/%E7%A2%8E%E7%89%87%E7%9F%A5%E8%AF%86%E7%82%B9/%E5%A6%82%E4%BD%95%E5%B0%86ELMo%E8%AF%8D%E5%90%91%E9%87%8F%E7%94%A8%E4%BA%8E%E4%B8%AD%E6%96%87/

from bilm-tf.

Both of these sound like good improvements, would you be willing to submit a PR?

from bilm-tf.

from bilm-tf.

Is it can support for chinese language? @hseelawi

from bilm-tf.

"char ids 0-255 come from utf-8 encoding bytes"
as the code above, it don't support for chinese，can you support for chinese?
@matt-peters

from bilm-tf.

@FynnYoung thanks !

from bilm-tf.