Comments (3)
From what I understood, we need a new dataset in .jsonl with text and labels.
Could you share datasets that this was trained on? Especially for not_news.
By reading the telegram contest I see that for russian content they mostly used lenta.ru archive.
But what about ukrainian?
from nyan.
Here you go: https://github.com/NyanNyanovich/nyan/releases/download/can_annot/cat_markup.tar.gz
I used Lenta and gpt-4 annotations, here is the script to query gpt-4: https://github.com/NyanNyanovich/nyan/blob/master/scripts/annotate_categories.py
And the training script: https://github.com/NyanNyanovich/nyan/blob/master/scripts/train_clf.py
from nyan.
@NyanNyanovich Thanks, I have found train_clf.py already and tried to train it with a single category but then on send.sh classificator failed probably because of "not_news" missing..
I have taken a dataset for Ukrainian news website which tagged their news, grouped only related to corruption and gotten about 700 entries which I united with categories_train.jsonl.
And after training I've became getting much worse results: many from war/politics became triggering corruption now and resulting as "unknown".
I have found out that in the added dataset the median text size is 1000+ characters when in yours about 450.
So I have a few questions about the hints for a dataset for the new category:
- Does smaller article size improves accuracy?
- Do multiple labels for the new category (like ["corruption", "war"] or ["corruption", "politics"]) will increase accuracy?
- What was your strategy (or was it random?) in news selection for your training dataset:
Labels sorted by Count:
politics: 1200 occurrences
war: 1062 occurrences
economy: 760 occurrences
incident: 699 occurrences
not_news: 451 occurrences
entertainment: 426 occurrences
tech: 418 occurrences
sports: 324 occurrences
science: 138 occurrences
other: 37 occurrences
- What are the other hints you might suggest?
from nyan.
Related Issues (13)
- @ parsing issue HOT 1
- when possible, prefer a neutral source for a quote? HOT 1
- Сделал форк HOT 1
- ValueError: max() arg is an empty sequence HOT 1
- [Suggestion] Generate a summary of all News throughout some time interval. HOT 2
- Resolved
- 8 hours summary using GPT not present HOT 7
- ./send.sh HOT 3
- Docker container size HOT 7
- main, clusters after first filter: 0 HOT 1
- Problem with AgglomerativeClustering HOT 2
- Mistake in the renderer.py
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nyan.