Git Product home page Git Product logo

language_detector's People

Contributors

feedbackmine avatar rubydev avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

sishen igrigorik nfo rainly rgaidot rubydev stevendaniels timhaines appozite guniorobot hkf qhoxie alepharchives pro100nagibatel shamantmy khekia destroying babanina domushnitsa fokycnuk tattooedgirl khkhpodrugadrugakhkh aribaaa khvenerakh fearphantom lorddartveyder costya kpubopy4ka ctasenok deyanira ragnorek pombredanne vid-io juliend2 flyeven simudream codegracie solertis

language_detector's Issues

Psych::SyntaxError

With ruby 2.0.0-p247 I've the follow error:

2.0.0p247 :001 > require 'language_detector'
 => true 
2.0.0p247 :002 > d = LanguageDetector.new
Psych::SyntaxError: (/Users/pioz/.rvm/gems/ruby-2.0.0-p247/gems/language_detector-0.1.0/lib/model-tc.yml): did not find expected key while parsing a block mapping at line 5 column 5
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:205:in `parse'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:205:in `parse_stream'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:153:in `parse'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:129:in `load'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:299:in `block in load_file'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:299:in `open'
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/lib/ruby/2.0.0/psych.rb:299:in `load_file'
    from /Users/pioz/.rvm/gems/ruby-2.0.0-p247/gems/language_detector-0.1.0/lib/language_detector.rb:141:in `load_model'
    from /Users/pioz/.rvm/gems/ruby-2.0.0-p247/gems/language_detector-0.1.0/lib/language_detector.rb:14:in `initialize'
    from (irb):2:in `new'
    from (irb):2
    from /Users/pioz/.rvm/rubies/ruby-2.0.0-p247/bin/irb:12:in `<main>'
2.0.0p247 :003 >

Source of language datasets

Where is the source text dataset for the Ngrams of those 96 languages? Would like to see if it is different from wooorm/franc#78 usage of UDHR, and if it is more accurate than them.

Better detection of Portuguese vs Spanish

I use this library to detect the language of Tweets. It's not perfect, but does pretty well given it only has 140 characters to work with.

My Spanish users complain that quite often Portuguese tweets get identified as Spanish Tweets. One of them said that the letter ç only belongs to Portuguese. ã and ê may also be used to further differentiate.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.