abrar199 / transly Goto Github PK

Transly is a sequence to sequence Bi-directional LSTM Encoder-Decoder model that's trained on the CMU pronouncing dictionary, IIT Bombay English-Hindi Parallel Corpus and IIT Kharagpur transliteration corpus.

The pronunciation module in Transly can predict pronunciation of any given word (with an American accent of course!)

Take any word of any language - just transliterate the word in English (all capitals) and you are good to go. Be it a new or old, seen or unseen, sensible or insensible word - Transly can catch'em all!

Another module in Transly is the transliteration module. It currently supports Hindi to English and English to Hindi transliterations.

Pre-trained models can be found inside the respective trained_models folders. New models can also be trained on custom data.

Use the package manager pip to install transly

pip install transly

Using the pre-trained pronunciation model

import transly.pronunciation as tp

# let's try a hindi word
# the prediction accent would be American
QUERY = 'MAKAAN'
a = tp.load_model(model_path='cmu')
a.infer(QUERY, separator=" ")

Training a new model on custom data

from transly.seq2seq.config import SConfig
from transly.seq2seq.version0 import Seq2Seq

config = SConfig(training_data_path=training_data_path, input_mode='character_level', output_mode='word_level')
s2s = Seq2Seq(config)
s2s.fit()
s2s.save_model(path_to_model=model_path, model_file_name=model_file_name)

Using the pre-trained model

import transly.transliteration as tl

QUERY = 'नहीं'
a = tl.load_model(model_path='hi2en')
a.infer(QUERY)

Using the pre-trained model

import transly.transliteration as tl

QUERY = 'NAHI'
a = tl.load_model(model_path='en2hi')
a.infer(QUERY)

Training a new model on custom data

from transly.seq2seq.config import SConfig
from transly.seq2seq.version0 import Seq2Seq

config = SConfig(training_data_path=training_data_path)
s2s = Seq2Seq(config)
s2s.fit()
s2s.save_model(path_to_model=model_path, model_file_name=model_file_name)

Training data file should be a csv with two columns, the input and the output

The Python code in this module is distributed with Apache License 2.0