CJK encoding support about goquery HOT 5 CLOSED

Yes, it is a limitation of Go's html package, it only supports UTF-8 encoded documents. From the docs:

It is the caller's responsibility to ensure that the Reader provides UTF-8 encoded HTML.

I believe CJK requires UTF-16, right? I'll leave this issue open for future reference, as this is an issue that needs to be resolved at a lower level than goquery.

from goquery.

you can use iconv for that

from goquery.

Thanks for the info, following on this I found the library https://code.google.com/p/go-charset/ (which has an iconv interface) by Roger Peppe, so this should be of high quality. Full doc: http://godoc.org/code.google.com/p/go-charset/charset

If someone feels like writing a little example, drop me a line and I'll add it to the doc (or the wiki).

from goquery.

There is no "CJK encoding".
UTF-16, some variant of Shift-JIS or EUC-JP, and one of myriad Chinese encodings all all different encodings.
For UTF16, check syscall_windows.go.
Otherwise (such as GBK), you'll need iconv, go-charset doesn't have them.

from goquery.

By the way, I found this package: https://code.google.com/p/go.text

from goquery.