Git Product home page Git Product logo

nlp-quality-estimiation's Introduction

Sentence-level Quality Estimation for English-German Machine Translation

Natural Language Processing (NLP hereafter) is taken the world by storm, it becomes the magic thing that makes people lives easier. One of the famous applications of NLP is Machine Translation, which aims at accurately expressing sentences in different languages. The input to the Machine Translation models is a sentence, and the output is, as well, a sentence but in different language. The main challenge with training Machine Translation models is finding the optimal output, and evaluating the predicted one. This usually involve lots of human effort which is not always possible. The field of Machine Translation Quality Estimation is becoming a very active area of research, which aims at building a Machine Learning (ML) based model that predicts the quality of the translated sentence.

In this project, we implemented different approaches to tackle this problem, starting from the use of traditional ML approaches, and concluding with more sophisticated ones that perform better in the provided data-set.

To run the project, please follow the following steps:

  1. Clone the repo by using the following command:

    git clone https://github.com/raghada/nlp-quality-estimiation.git

  2. Create a new python enviroment:

    python3 -m venv nlp-env

  3. Activate the enviroment:

    source nlp-env/bin/activate

  4. Install requirmenets.txt, using the following command:

    pip install -r requirements.txt

  5. Run the project with this command:

    python3 main.py --strategy 4

Note: sending the value 4 will run the project with all strategies, if you wish to specifiy a strategy, please indicate its number (1, 2, or 3)

nlp-quality-estimiation's People

Contributors

raghada avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.