Git Product home page Git Product logo

mlator's Introduction

By Zack Pan, Yuhan Wang, Wei Wei, Tianqi Wang, Minchen Wang, Harrison Mamin, and Alan Perry

MLator is a project we worked together on to supply the Manga industry with an alternative to slow, low quality automated translation and expensive human translation.

It is an end to end product, with a backend which controls the logic of the application, a model which does the prediction for translation, and the front end which communicates between the user and the server.

Model

1. Text Bubble Detection

SSD

Demonstration

2. OCR

CRNN

Demonstration

3. Mask original Japanese characters

U-net

4. Tranlation

Google API

Demonstration

5. Putting back the translated English

Rule based model

Demonstration

Backend

The backend used an RDS server to store user information. We managed images locally to reduce processing time. We controlled a users access using an login system. This would be used to do analysis on a visitor level. The server was a gunicorn application which we ran on an EC2 instance. As of now the application is not running because of the costs.

We practiced safe input detection. Not checking for bad input, but making sure all input is good instead.

Front End

Logo The goal of front end was to aid users in deciding if they want to use our product. This was done through a walk through of all of the steps in our model.

After the user has read about how our model works and has decided they want to try it, there is a demo at the bottom of the home page which lets you drag and drop an image onto a square and in a few seconds a translated version is displayed on the right.

Should the user want, there is a log in system which lets a user make batch requests. Here they can drag and drop multiple images at once. There is feedback on how far in the process the translation is. Once all of the images are translated, a download button will start a download of all the user's translated text.

All forms used CSRF validation to protect us from cross-site request forgeries as well. Using Javascript we provided useful feedback without waiting on slow network request times.

Demonstration

Demonstration

Future Development

With more time we would have given the ability to download previously translated projects.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.