The arff from mbillingr

arff's People

Contributors

Stargazers

Watchers

arff's Issues

Error parsing unquoted strings that contain '0'

Example:

@ATTRIBUTE pixel10 real is parsed as "@ATTRIBUTE", "pixel1", "0 real".

Example of OpenML arff deserialization

Thanks for this crate!

I'm trying to load the MNIST dataset from OpenML in Arff format, and so far

extern crate serde;

extern crate arff;    
use std::fs;   
use serde::Deserialize;


fn main() {
    
    let contents = fs::read_to_string("/tmp/mnist_784.arff").expect("Error!");
                                     
    let unnamed_data: Vec<(f32,)> = arff::from_str(&contents).unwrap();   
    println!("{:?}", unnamed_data);
}

panics due to column dtype validation,

   Compiling arff-rust-parser v0.1.0 (/home/rth/projects/scikit-learn/arff-rust-parser)
    Finished dev [unoptimized + debuginfo] target(s) in 0.54s
     Running `target/debug/arff-rust-parser`
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: InvalidColumnType(TextPos { line: 11, column: 18 }, "\tREAL")', src/libcore/result.rs:999:5
note: Run with `RUST_BACKTRACE=1` environment variable to display a backtrace.

possibly because the metadata says that colums are real, while they are integers.

@ATTRIBUTE pixel1       real
@ATTRIBUTE pixel2       real
@ATTRIBUTE pixel3       real

@DATA
0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0 [..] 0,0,5

It would be nice if there was an example of loading a dataset from OpenML. A am aware of openml-rust but I'm looking for just a fast ARFF parser that I could use as a replacement for liac-arff.

Recommend Projects