prepro.py crashes on Unicode captions about neuraltalk2 HOT 3 OPEN

ahhh, unicode hassles... thanks for reporting this. I'd rather find which part of the code assumes ascii and fix it to work with unicodes. I'm on vacation right now but when I get back I could try to hunt around a bit. The problem we had with this strategy (and the thing to watch out for) in char-rnn is that unicode support made the code much slower, and the memory footprint much larger, etc. It's not clear if we'd run into the same problems here.

from neuraltalk2.

I would guess not, because isn't that the point of parsing the captions into individual words and then creating a word->bit mapping vocabulary? Actually, I've been wondering for a while: did you ever try putting char-rnn rather than a word-level rnn on top of neuraltalk2, or is Coco not big enough to train that too?

from neuraltalk2.

Good point, neuraltalk2 works mostly on level of indices and the main script isn't too aware of the mappings. I also wrote the code specifically in such a way that character-level extensions would be easy in the future. I haven't actually tried this for lack of time, but in principle this should require a very small change in the prepro python file, where instead of splitting sentence tokens by space you split by each character. The only thing to worry about is that by default the max_seq_length is 16, but in this case you'd want that to be quite a bit higher. But in principle nothing preventing it, and the train script should be indifferent, all it sees are images and sequences of integers.

from neuraltalk2.