Sample Machine Learning datasets on DataHub about datahub-qa HOT 11 CLOSED

FIXED! We added new datasets from open-ml at datahub.io/machine-learning and wrote a blog post about ARFF format specifically https://datahub.io/blog/attribute-relation-file-format-arff

from datahub-qa.

You can for example use any data set from OpenML and extract the relevant info to create the data package.

Example in R:

library("OpenML")
eyedat <- getOMLDataSet(data.name = "eeg-eye-state")
str(eyedat)

The same can be done in python, java, ... (whatever you prefer, see OpenML website).

from datahub-qa.

@HeidiSeibold great. Do you have any recommendations on a top-5 "getting started" datasets you'd recommend for us to data package?

from datahub-qa.

There is a collection called OpenML 100 with interesting (classification) data sets. It was collected as a quick way to do benchmarking with OpenML.

Maybe the first 5 of those 😉

from datahub-qa.

@HeidiSeibold thanks - if you have any tips on which ones you'd especially recommend let us know.

@Mikanebu please take a look through these datasets and see how they work and if there any that you think would be good

From my own quick browse i found:

• https://www.openml.org/d/458 - which itself is taken from this original source of 98 datasets http://people.stern.nyu.edu/jsimonof/AnalCatData/ -
  http://people.stern.nyu.edu/jsimonof/AnalCatData/Data/ (however i'm not sure how we'd find metadata for each of these)

from datahub-qa.

@rufuspollock ok, I will take a look

from datahub-qa.

Also found https://archive.ics.uci.edu/ml/datasets.html

from datahub-qa.

@HeidiSeibold we've started data packaging some machine learning datasets here http://datahub.io/machine-learning

Any feedback or suggestions for next steps would be very welcome 😄

from datahub-qa.

Cool, thanks 🎉 . So there is at least one data set that is both in your collection as well as on OpenML:

• http://datahub.io/machine-learning/seismic-bumps
• https://www.openml.org/d/1500

I guess a first step now would be to check:

• which fields in the datapackage correspond to which fields in the ARFF file / XML file.
• if there is any information in the ARFF file / XML file that we cannot get from the data package.

Is the R package for data packages stable yet? That would make it very easy because then we could just convert between the file formats in R, I think.

from datahub-qa.

Awesome, thanks @Branko-Dj! Do you have code for the transformation from ARFF to data package that we could share?

from datahub-qa.

@HeidiSeibold Currently we would do it by transforming arff file to csv by using pre-existing scripts (https://github.com/haloboy777/arfftocsv for example) and then create data package for the csv file.

from datahub-qa.