mastafaf / multilingual_similarity_compare Goto Github PK
View Code? Open in Web Editor NEWLicense: Other
License: Other
@MastafaF
which machine translation code do you recommend for translating between arabic and urdu
It could be worth to add benchmarks for the new Language-agnostic BERT Sentence Embedding (LaBSE)
https://arxiv.org/pdf/2007.01852.pdf
The model is available already on tensorflow hub
At the moment, we set the batch_size to 32 without any way for the user to change it.
Link that to issue on mean pooling. Test on mean pooling updated coming.
The lower the better I assume, is it the error rate your tracking?
Input:
sh similarity_XLM-R_batch.sh 40 mean True
Output:
Confusion matrix:
langs cs de en es fr avg
cs 0.00% 91.31% 97.64% 98.37% 94.34% 95.41%
de 93.84% 0.00% 88.05% 92.87% 95.40% 92.54%
en 91.21% 77.79% 0.00% 72.56% 94.77% 84.08%
es 95.47% 93.14% 61.84% 0.00% 90.28% 85.18%
fr 91.97% 81.25% 77.12% 71.96% 0.00% 80.58%
avg 93.12% 85.87% 81.16% 83.94% 93.70% 87.56%
Input:
sh similarity_XLM-R_batch.sh 100 mean True
Output:
Confusion matrix:
langs cs de en es fr avg
cs 0.00% 91.24% 97.77% 97.80% 92.11% 94.73%
de 94.31% 0.00% 86.55% 92.44% 94.67% 91.99%
en 91.08% 74.93% 0.00% 71.56% 77.69% 78.81%
es 95.37% 88.38% 58.54% 0.00% 90.38% 83.17%
fr 92.71% 91.58% 87.41% 89.14% 0.00% 90.21%
avg 93.36% 86.53% 82.57% 87.74% 88.71% 87.78%
distilBERT with CPU, MAX_LEN = 100
100% 3003/3003 [06:54<00:00, 7.30it/s]
100% 3003/3003 [07:15<00:00, 7.25it/s]
100% 3003/3003 [07:06<00:00, 7.75it/s]
100% 3003/3003 [06:35<00:00, 7.91it/s]
100% 3003/3003 [06:31<00:00, 8.07it/s]
distilBERT with GPU, MAX_LEN = 100:
LENGTH OF TOTAL DOCUMENT 3003
-- Encoder: 3003 sentences in 35s
LENGTH OF TOTAL DOCUMENT 3003
-- Encoder: 3003 sentences in 35s
LENGTH OF TOTAL DOCUMENT 3003
-- Encoder: 3003 sentences in 35s
LENGTH OF TOTAL DOCUMENT 3003
--Encoder: 3003 sentences in 35s
LENGTH OF TOTAL DOCUMENT 3003
-- Encoder: 3003 sentences in 34s
! sh similarity_distilBERT_batch.sh 50 mean True
Output:
Confusion matrix:
langs cs de en es fr avg
cs 0.00% 99.97% 99.97% 99.97% 99.97% 99.97%
de 100.00% 0.00% 100.00% 100.00% 100.00% 100.00%
en 99.97% 99.97% 0.00% 99.97% 99.97% 99.97%
es 99.97% 99.97% 99.93% 0.00% 100.00% 99.97%
fr 99.97% 99.97% 99.97% 99.97% 0.00% 99.97%
avg 99.98% 99.97% 99.97% 99.98% 99.98% 99.97%
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.