Comments (6)
I'm sorry @gheinrich but this is inconvinient. I am currently running digits on a server, so when I use the option Upload image list for the Classify Many functionality I get to choose a file from my local machine, so I have to download it and upload it again.
If a test set is available for this dataset and no image list is uploaded, one would expect Classify Many to run over the test set.
from digits.
From https://groups.google.com/forum/#!topic/digits-users/JnXVuckUUG0:
It would be good if DIGITS can draw a confusion matrix at the end of training...
something which needs to run things again from outside using scripts...
from digits.
My plan for this is to only calculate the final accuracy and confusion matrix if the user provides a test dataset in addition to the training and validation sets. Once I implement this feature, I'll change the default folder splits to something like 60/20/20 (train/val/test) so that people will see it by default.
from digits.
Default folder splits sound perfect. In terms of the user flow I would envisage something along the lines of a dropdown/checkboxes for potential tests e.g. accuracy, confusion matrix, top-k matches etc., combined with the existing area to upload a test set specification file.
from digits.
Implemented with #608
Just use the test.txt
file from your dataset job folder.
from digits.
My plan for this is to only calculate the final accuracy and confusion matrix if the user provides a test dataset in addition to the training and validation sets. Once I implement this feature, I'll change the default folder splits to something like 60/20/20 (train/val/test) so that people will see it by default.
It will be great if the same function can also be applied to object detection. Currently I can only get the predicted bbox location and confidence score(still dont know how it is calculated) for one test image using python or REST_API. I am wondering why DIGITS can't output the same accuracy visualization for test images as it does for val dataset. I am sure it is necessary for many user to check the generlaization of trained model on additional images.
Thanks!
from digits.
Related Issues (20)
- How to upload pretrained model with digits:20.03-tensorflow-py3
- Isn't the dataset parallelized?
- Convert YOLO Labels to KITTI Labels
- AWS DIGITS: ERROR: ValueError: invalid literal for int() with base 10
- Failed to build Caffe on Xavier NX
- KITTI Data Trains in TF but not in Digits
- DIGITS OBJECT DETECT DATASET TRAINING ERROR HOT 1
- map validation
- How to change digits default gpu number '0'?
- DIGITS 6 docker - Can't train MNIST demo
- Nvidia A100 & Caffe Container HOT 1
- where to download Digit 21.2 ?
- Building Caffe with CUDA
- Detectnet, Multiple class object detection with an imbalanced dataset, Poor results (mAP) for one class
- Module Creation erros
- cannot see detectnet bounding boxes using Caffe model on Nano
- Is there a way to backup the entire database? HOT 1
- I'm confused between which version of DIGITS to install
- Inference HOT 7
- DIGITS DOCKET CONTAINER INSTALLING SUNNY PLUGIN HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from digits.