grseb9s / datasets-links-collection Goto Github PK

About

Own collection of links to various datasets

Datasets Links

Data sets for machine learning in Python (github repository)

• https://github.com/jaberg/skdata

ML-friendly Public Datasets (article on Kaggle)

• https://www.kaggle.com/annavictoria/ml-friendly-public-datasets/

Public Data (List of Data Marketplaces):

• http://www.bigdata-startups.com/public-data/

UC Irvine Machine Learning Repository:

• http://archive.ics.uci.edu/ml/

Opendata by Socrata

• https://opendata.socrata.com/

Data from Publications:

• http://figshare.com/

KDnuggets datasets:

• http://www.kdnuggets.com/datasets/index.html

Networks Datasets:

• http://konect.uni-koblenz.de/networks/

Link to "Open Data" provided in the comments of ResearchGate.Net:

• http://web.ist.utl.pt/acardoso/datasets/
• http://webspam.lip6.fr/wiki/pmwiki.php

SNAP - Stanford Network Analysis Project:

• http://snap.stanford.edu/data/
• http://snap.stanford.edu/data/links.html
• http://snap.stanford.edu/data/other.html

The daily news cycle [9*~2.0 GB]:

• http://www.memetracker.org/data.html
• https://pslcdatashop.web.cmu.edu/index.jsp

S5 - A Labeled Anomaly Detection Dataset [~16M]

• http://webscope.sandbox.yahoo.com/catalog.php?datatype=s&did=70

GeoLife GPS Trajectories [298.66 MB]

• http://research.microsoft.com/en-us/downloads/b16d359d-d164-469e-9fd4-daa38f2b2e13/

T-Drive trajectory data sample [~140 MB]

• http://research.microsoft.com/apps/pubs/?id=152883

Public Data Sets on AWS:

• http://aws.amazon.com/publicdatasets/#1

Wikipedia Revision History [314 millions of rows]:

• https://developers.google.com/bigquery/docs/dataset-wikipedia

Data for Data Scientists:

• http://www.kaggle.com/

Linked Open Data by NY Times[RDF]:

• http://data.nytimes.com/#

WikiData

• http://www.wikidata.org/

DBpedia

• http://dbpedia.org/About

Global Database of Events, Language, and Tone (GDELT)

• http://gdelt.utdallas.edu/data.html#reduced

PSLC DataShop in Pittsburgh

• https://pslcdatashop.web.cmu.edu/index.jsp?datasets=public

Labeled Faces in the Wild[images of faces]

• http://vis-www.cs.umass.edu/lfw/index.html

Mobile Data Challenge (MDC) Dataset:

• https://www.idiap.ch/dataset/mdc

Machine Learning Datasets Repository:

• http://mldata.org/

Хаб открытых данных на русском языке:

• http://hubofdata.ru/

US Open Data Action Plan and Datasets:

• http://www.kdnuggets.com/2014/05/us-open-data-action-plan-data-sets.html

70+ websites to get large data repositories for free:

• http://www.bigdata-madesimple.com/70-websites-to-get-large-data-repositories-for-free/

http://www.hpi.uni-potsdam.de/naumann/projekte/repeatability/datasets.html

StatLib---Datasets Archive

• http://lib.stat.cmu.edu/datasets/

100+ Interesting Data Sets for Statistics

• http://rs.io/100-interesting-data-sets-for-statistics/

Big Data: 20 Free Big Data Sources Everyone Should Know

• http://smartdatacollective.com/bernardmarr/235366/big-data-20-free-big-data-sources-everyone-should-know

Find and Use Data

• https://www.quandl.com/

CKAN, the world’s leading open-source data portal platform

• http://ckan.org/

InfoChimps

• http://www.infochimps.com/datasets

Repositories of datasets

• http://www.trustlet.org/datasets/

Quantnet - A Database-Driven Online Repository of Scientific Information

• http://sfb649.wiwi.hu-berlin.de/quantnet/

A community-curated database of well-known people, places, and things

• http://www.freebase.com/

Answer on Quora "Where can I find large datasets open to the public?":

• http://www.quora.com/Where-can-I-find-large-datasets-open-to-the-public?q=dataset

Enron Email Dataset (Famous Public E-mails Dataset)

• https://www.cs.cmu.edu/~./enron/

GENESIS-Online Database (Statistisches Bundesamt)

• https://www-genesis.destatis.de/genesis/online

Microsoft

• http://research.microsoft.com/apps/mobile/showpage.aspx?page=/en-us/projects/data-science-initiative/default.aspx#datasets

The 20 Newsgroups data set is a collection of approximately 20,000 newsgroup documents

• http://qwone.com/~jason/20Newsgroups/

Awesome Public Datasets (GitHub)

• https://github.com/caesar0301/awesome-public-datasets

LETOR: Learning to Rank for Information Retrieval

• http://research.microsoft.com/en-us/um/beijing/projects/letor/

Miscellaneous

• https://archive-it.org/explore?show=Collections
• https://delicious.com/pskomoroch/dataset

Energy

• Solar Measurement Grid Oahu, Hawaii by NREL
  • First analysis - https://github.com/vdmitriyev/data-analysis-notebooks/tree/master/nrel-oahu-solar
• UK Domestic Appliance-Level Electricity (UK-DALE) dataset
  • Github repository - https://github.com/JackKelly/UK-DALE_metadata
• Open PV Dataset (Tracking the Sun, Berkeley)
• Energy efficiency Data Set from UCI
  • Analysis is here - https://github.com/vdmitriyev/data-analysis-notebooks/tree/master/energy-residential-buildings
• PLAID: the Plug Load Appliance Identification Dataset

• https://github.com/jingkungao/PLAID/blob/master/ParseData.ipynb

• Indian Dataset for Ambient Water and Energy (IWAE)

Water

• SmartH2O Project
  • https://zenodo.org/record/556152#.WgsNsWjWxhF
  • http://smarth2o.deib.polimi.it/results/datasets/