quynhneo / detm-arxiv Goto Github PK

Thanks for open-sourcing this project! I'm interested in working with DETM so I've been experimenting with this and your fork of the original DETM code.

With the arXiv data, do you have a baseline perplexity score or other metric for me to compare results to? I'd like to make sure my modified code performs similarly to yours on the preprint Kaggle dataset before being too confident that it's working right.

Hey, I'm writing this issue to inform you about an error occured to me when using multi-GPU training.

File "/home/[]/DETM-arxiv/detm.py", line 212, in init_hidden
    weight = next(self.parameters())
StopIteration
StopIteration: Caught StopIteration in replica 0 on device 0.

This is much of a known issue in Pytorch world. As Pytorch are moving away from Dataparallel they would much unlikely to solve this, and the better way to do this is to change the code to suit for the new DistributedDataParallel.

Thanks!

I tried using your script to train DETM but this error occur. pls can you help me fix it

Traceback (most recent call last): File "main.py", line 476, in <module> train(epoch) File "main.py", line 217, in train loss, nll, kl_alpha, kl_eta, kl_theta = model(data_batch, normalized_data_batch, times_batch, train_rnn_inp, args.num_docs_train) File "/usr/local/lib/python3.6/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl result = self.forward(*input, **kwargs) File "/content/drive/My Drive/eu/run_file/detm.py", line 199, in forward theta, kl_theta = self.get_theta(eta, normalized_bows, times) File "/content/drive/My Drive/eu/run_file/detm.py", line 161, in get_theta eta_td = eta[times.type('torch.LongTensor')] IndexError: index 66 is out of bounds for dimension 0 with size 66