Git Product home page Git Product logo

bharathreddy1997's Projects

rnn.wgan icon rnn.wgan

Code for training and evaluation of the model from "Language Generation with Recurrent Generative Adversarial Networks without Pre-training"

text-generation-using-gan-and-rnn icon text-generation-using-gan-and-rnn

Automatically generating syntactically correct and semantically meaningful text has many applications in dialogue systems, image captioning, machine translation and more. Indeed, while the most advanced of today's rule-based chatbots may not be able to generate good conversation, AI systems based on machine learning can perform better. This paper describes and compares two methods for generating artificial text namely using GANs (Generative Adversarial Networks) and using RNNs (Recurrent Neural Networks). We apply these to three different domains namely communications between ATC (Air traffic control) and pilots, children's nursery rhymes and the poetry of the Irish poet Seamus Heaney. In each case we work with small vocabularies and small amounts of training data as that is our use case. Sample texts based on training data from each domain from the RNN and the GAN approaches are evaluated using BERT's score and in the case of Heaney's poetry we also include extensive feedback from survey respondents. Our findings are that realistic text can be generated in each domain even with small amounts of training data and we conclude that in such scenarios, RNN-generated text is better than GAN-generated, as well as being less computationally expensive.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.