superscriptjs / normalizer Goto Github PK

Hey,

I wanted to understand the reasoning for which "+" was added between words. The "readme" mentions that it was done so that the "idiom" processor does not remove them. Why do we need this behaviour? It makes the sequential application of regex improper for some cases. Ex. We were excepting to normalize "I don't think so" to "~no" but because of "+", the sentence gets converted to "i do+not think so" and then the idiom processor fails.

How can we solve this?

Hi,

I'm wondering if it would be possible to support multiple languages here (and in the other parts of the bot, like QTypes.) of if this implementation only focuses on american english?

I think supporting various languages would cause a lot of problems (different grammar, different semantic types, translation needed to use ConceptNet...) but would also add a lot of value to the library. There are a lot of people out there who a not native english speakers ;)

RE2 dep breaks the ability to run in non-node environments (like the browser).

Tests pass just fine with using normal RegExp objects. I have the code - would you accept a PR?

Hey,

Just wondering if you could provide a usage example / sample code for Normalizer?

Cheers.

So I have installed the package via npm, so how do I normalize text?