Comments (5)
@stillbetter There exists several (at least two) versions of this dataset.
By the way, according to my records of the downloaded data, KonIQ-10k
dataset also has several versions. If you feel confused, you may write an email to the dataset owner.
I downloaded this dataset a long time ago.
During the time, the dataset owner had renamed the video clips, i.e., simplifying the name.
You can re-make the KoNViD-1kinfo.mat
with the right CSV file.
What you need to ensure is every video clip has its truly corresponding MOS.
Now I cannot access the konvid-1k-database. You may ask the dataset owner for confirmation.
from vsfa.
Got it.Thanks!
from vsfa.
Sorry for another question, I check the log file, I found the SROCC/PLCC/KROCC can reach a peak performance at around 100 epochs, then the figures get bad . Is that a little bit overfitting? Thanks!
from vsfa.
@stillbetter We use a standard procedure, i.e., training the model on the train data, saving the model based on validation data (That is, we monitor the validation performance, then save the best model.), and then testing the saved model on the test data.
If you see the training loss becomes smaller and smaller and the validation performance first increases and then decreases, you can say the model training is facing the overfitting issue.
This means there is no need to continue the training process unless you have a solution (e.g., add more data) to the overfitting issue. And if you have an elegant training strategy, the model performance may be further improved.
I did not tune the settings separately on each dataset for better performance.
I just set the default epochs
as 2000
for all three datasets. The settings of other hyperparameters also matter, e.g., args.decay_interval = int(args.epochs/10)
.
For this dataset, smaller epochs
may be enough if no elegant solution to the overfitting issue.
However, you should also take a look at the curves on the other two datasets.
For the other two datasets, epochs>2000
may obtain a better performance, which means the model did not reach the perfect convergence state in the default settings.
from vsfa.
Great!Thanks for the enthusiastic and patient answner.I'll bother if any question again.
from vsfa.
Related Issues (20)
- [alternative links of the datasets] How to download KoNViD-1k and LIVE-Qualcomm? HOT 7
- 跨数据库测试 HOT 3
- hyper-parameters & motion-related features HOT 5
- 时间记忆效应参数选择 HOT 1
- VSFA's Performance comparision with VIIDEO HOT 2
- Pretrained Weights HOT 6
- Question about V-BLIINDS&NIQE HOT 2
- Loss Function! HOT 2
- The question about GRU setting HOT 1
- Question about CORNIA HOT 1
- How to download LIVE-VQC? Is there baidu disk link ? Thanks for a help HOT 10
- Performance on LIVE-VQC HOT 6
- How to get the data/KoNViD-1kinfo.mat? HOT 1
- 有关 Content-Aware Feature Extraction部分的spatial global average pooling operation的问题 HOT 2
- 请问数据读取是否有问题呢? HOT 1
- [Qustion] On the training the CNN networks HOT 2
- [Qustion] Overfitting problem HOT 4
- Is it possible to share VBLIINDS features for live qualcomm and konvid-1k? HOT 1
- 请问KoNViD-1k数据集没有指定的验证集嘛 HOT 1
- Results in MSU Video Quality Metrics Benchmark
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vsfa.