Amazing free Machine Learning and Deep Learning public data sources for 2018

These public data sources can be used for machine learning and deep learning research. Datasets are an integral part of the field of machine learning.

Finding a good machine learning dataset is often the biggest hurdle a developer has to cross before starting any data science project. Whether you’re new to machine learning, or a professional data scientist, finding a good machine learning dataset is the key to extracting actionable insights.

Below is an up-to-date list of freely available data sources.

World Bank Open Data

Datasets covering population demographics and a huge number of economic and development indicators from across the world.

IMF Data

The International Monetary Fund publishes data on international finances, debt rates, foreign exchange reserves, commodity prices and investments.

The US National Center for Education Statistics

Data on educational institutions and education demographics from the US and around the world.

The UK Data Centre

The UK’s largest collection of social, economic and population data.

5 FiveThirtyEight

A large number of polls providing data on public opinion of political and sporting issues.

FBI Uniform Crime Reporting

The FBI is responsible for compiling and publishing national crime statistics, with free data available at national, state and county level.

Bureau of Justice

Here you can find data on law enforcement agencies, jails, parole and probation agencies and courts.

Qlick Data Market

Offers a free package with access to datasets covering world population, currencies, development indicators and weather data.

NASA Exoplanet Archive

Public datasets covering planets and stars gathered by NASA’s space exploration missions.

UN Comtrade Database 

Statistics compiled and published by the United Nations on international trade. Includes Comtrade Lab which is a showcase of how cutting edge analytics and tools are used to extract value from the data.

Financial Times Market Data

Up to date information on financial markets from around the world, including stock price indexes, commodities and foreign exchange.

Google Trends

Examine and analyze data on internet search activity and trending news stories around the world.

Twitter

The advantage Twitter has over the others are that most conversations are public. This means that huge amounts of data is available through their API on who is talking about what, where, when and why.

Google Scholar

Entire texts of academic papers, journals, books and legal case law.

Instagram

As with Twitter, Instagram posts and conversations are public by default. Their APIs allow likes, mentions and business details to be analyzed.

OpenCorporates

The world’s largest open database of companies.

Glassdoor API

Information about job vacancies, candidates, salaries and employee satisfaction is available through their developer API.

IMDB Datasets

Datasets in a number of formats drawn from the web’s largest resource on movies, television and people working in those industries.

OpenLibrary Data Dumps

Datasets on books including catalogues from libraries around the world

Labelled Faces in the Wild

13,000 collated and labelled images of human faces, for use in developing applications involving facial recognition.

Microsoft Marco

Microsoft’s open machine learning datasets for training systems in reading comprehension and question answering.

Machine Learning Dataset Repository

Collection of open datasets contributed by data scientists involved in machine learning projects.

EBay Market Data Insights

Data on millions of online sales and auctions from Ebay

Natural History Museum Data Portal

Information on nearly 4 million historical specimens in the London museum’s collection, as well as scientific sound recordings of the natural world.

CERN Open Data

More than one petabyte of data from particle physics experiments carried out by CERN.

One Million Audio Cover Images

Dataset hosted at archive.org covering music released around the world, for use in image processing research

Complete Public Reddit Comments Corpus

Over one billion public comments posted to Reddit between 2007 and 2015, for training language algorithms

Microsoft Azure Data Markets Free Datasets

Freely available datasets covering everything from agriculture to weather

Irish Electric Vehicle Charge Point Status

Collates data from the body which oversees the network of EV charge points across the Republic of Ireland and Northern Ireland.

LondonAir

Pollution and air quality data from across London

 

AISOMA

Take a look at our FIFA World Cup 2018 Prediction