Comments (6)
Hey @ManyTheFish! Waiting for your review to this above PR by @tkhshtsh0917. I actually doubt whether that's the complete solution. Because even after that if you run cargo test --verbose --features chinese-normalization-pinyin
it executes all 102+9 tests which is what happens when you simply run cargo test
. I might be wrong about this. I'm sorry, I'm just curious and want to know more about this project.
from charabia.
Hello @Soham1803 and @tkhshtsh0917, you are right. The number of tests doesn't change; however, they are not exactly the same. In the Chinese normalizer tests the expected result change depending on the feature flag. Whit your PR, both sides will be tested.
from charabia.
Oh yes! I get it now. Thanks @ManyTheFish for clearing my doubt and all the best @tkhshtsh0917 with your PR. 😊
from charabia.
Just to be clear, what's expected here is the new CI command i.e. cargo test --verbose --features chinese-normalization-pinyin
instead of the older cargo test --verbose --features chinese chinese-normalization-pinyin
which currently runs fine. Am I right?
When currently we run cargo test --verbose --features chinese-normalization-pinyin
total 102+9 tests run whereas we expect only one test related to chinese normalizer to run.
from charabia.
I made a mistake when putting cargo test --verbose --features chinese chinese-normalization-pinyin
because in this case the flag chinese-normalization-pinyin
is ignored, the proper command to run would be cargo test --verbose --features chinese,chinese-normalization-pinyin
.
But cargo test --verbose --features chinese-normalization-pinyin
is sufficient.
The goal is to ensure that the code under this flag is tested and works. Currently it doesn't.
from charabia.
Hi @Soham1803! I would like to properly understand your thoughts, are you arguing that we should use a trick where only the features specified in cargo test --features
are tested and other features are skipped?
Like this?
ref: https://stackoverflow.com/questions/77529267/how-to-run-only-tests-marked-with-a-specific-feature-and-ignoring-the-rest
from charabia.
Related Issues (20)
- Tokenization of japan text with disabled default features HOT 3
- Test this library against invalid and strange input
- Implement the `CharNormalizer` trait on the `LowercaseNormalizer` struct
- Ð vs Đ differentiate HOT 7
- Add Khmer support information to README
- remove unnecessary iteration in khmer segmenter HOT 2
- Fix kvariant CI
- Compiler failure without vietnamese feature
- Compilation warnings when not using default features
- Cross-compiling charabia for arm HOT 5
- Normalize "œ" / "æ" into "oe" / "ae"
- Numbers are not segmented the same way depending on the Script/Language HOT 11
- [Maintainance] Review and amend documentation in files
- Tag and release new version? HOT 1
- Rework Chinese Pinyin normalizer
- latin-camelcase feature make wrong segmentation HOT 11
- Normalization Issue for Turkish Characters in Charabia HOT 3
- Add Math symbols in the default separator list
- Persian language support for normalization and segmentation HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from charabia.