ssemeniuta / textvae Goto Github PK

Dropbox link is no longer working :)

Hello! I have a simple and possibly silly question here. In my training runs, the kld term, as logged to costs by vae.py, is always negative, creeping upwards toward zero. Is that expected behavior?

Then, I see that the kld is subtracted from reconstruction_loss in the calculation of the overall cost. Shouldn't kld be positive, and added to reconstruction_loss?

Here's an example of what I'm seeing:

(I've set anneal_start=0 and anneal_end=100 here just for demonstration purposes.)

Thanks for a great paper and a very usable code release!

What is the license for the Theano code in the repo?

loading exp/twittervae.charlevel.z_100.len_128.p_0.00.lstmsz_1000.alpha_0.20/model.flt
File "C:/Users/eyaler/Dropbox/python/text_vae/textvae/twitter_vae_sample_charlevel.py", line 163, in
main(**vars(args))
File "C:/Users/eyaler/Dropbox/python/text_vae/textvae/twitter_vae_sample_charlevel.py", line 31, in main
model.load("exp/%s/model.flt" % name)
File "C:\Users\eyaler\Dropbox\python\text_vae\textvae\nn\models\base_model.py", line 89, in load
params = flt.load()
File "C:\Users\eyaler\Dropbox\python\text_vae\textvae\nn\utils.py", line 77, in load
arr = self.load_array()
File "C:\Users\eyaler\Dropbox\python\text_vae\textvae\nn\utils.py", line 104, in load_array
return arr.reshape(dims)
ValueError: cannot reshape array of size 100 into shape (259,)