Git Product home page Git Product logo

detm-arxiv's Introduction

Hi there, I am Quynh (pronounce almost like Quinn) πŸ‘‹

  • I am a physicist by training, and my main career is in physics. My GitHub is mostly about data science/machine learning projects.

  • πŸ”­ I worked on topic modeling and dialect map of the arxiv articles in collaboration with Professor of Physics Kyle Cranmer, Sinclert PΓ©rez and Data Science and Software Services at New York University.

  • Open-source highlights:

    Big texts and graph mining tools: arxiv-public-datasets. I contributed to adapting the packages to a new data pipe line from Google Cloud Service.

    Image Processing Tools: PIVlab. This is the most popular open source Particle Image Velocimetry MATLAB program, cited in thousands of research articles. I contributed to its parallelization and the design of the command line interface. I am also a maintainer of the project.

    I have also peer-reviewed for the Journal of Open Source Software (JOSS).

  • πŸ“« How to reach me: Please e-mail

detm-arxiv's People

Contributors

quynhneo avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

detm-arxiv's Issues

An error running your DETM script

I tried using your script to train DETM but this error occur. pls can you help me fix it

Traceback (most recent call last): File "main.py", line 476, in <module> train(epoch) File "main.py", line 217, in train loss, nll, kl_alpha, kl_eta, kl_theta = model(data_batch, normalized_data_batch, times_batch, train_rnn_inp, args.num_docs_train) File "/usr/local/lib/python3.6/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl result = self.forward(*input, **kwargs) File "/content/drive/My Drive/eu/run_file/detm.py", line 199, in forward theta, kl_theta = self.get_theta(eta, normalized_bows, times) File "/content/drive/My Drive/eu/run_file/detm.py", line 161, in get_theta eta_td = eta[times.type('torch.LongTensor')] IndexError: index 66 is out of bounds for dimension 0 with size 66

PPL scores for replication/comparison?

Thanks for open-sourcing this project! I'm interested in working with DETM so I've been experimenting with this and your fork of the original DETM code.

With the arXiv data, do you have a baseline perplexity score or other metric for me to compare results to? I'd like to make sure my modified code performs similarly to yours on the preprint Kaggle dataset before being too confident that it's working right.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.