World Library  
Flag as Inappropriate
Email this Article

Data set

Article Id: WHEBN0000008495
Reproduction Date:

Title: Data set  
Author: World Heritage Encyclopedia
Language: English
Subject: Data mining, Caltech 101, Data citation, Oversampling and undersampling in data analysis, Polity data series
Collection:
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Data set

A data set (or dataset) is a collection of data.

Most commonly a data set corresponds to the contents of a single database table, or a single statistical data matrix, where every column of the table represents a particular variable, and each row corresponds to a given member of the data set in question. The data set lists values for each of the variables, such as height and weight of an object, for each member of the data set. Each value is known as a datum. The data set may comprise data for one or more members, corresponding to the number of rows.

The term data set may also be used more loosely, to refer to the data in a collection of closely related tables, corresponding to a particular experiment or event. An example of this type is the data sets collected by space agencies performing experiments with instruments aboard space probes.

History

Historically, the term originated in the mainframe field, where it had a well-defined meaning, very close to contemporary computer file.

Properties

Several characteristics define a data set's structure and properties. These include the number and types of the attributes or variables, and various statistical measures applicable to them, such as standard deviation and kurtosis.[1]

The values may be numbers, such as real numbers or integers, for example representing a person's height in centimeters, but may also be nominal data (i.e., not consisting of numerical values), for example representing a person's ethnicity. More generally, values may be of any of the kinds described as a level of measurement. For each variable, the values are normally all of the same kind. However, there may also be missing values, which must be indicated in some way.

In statistics, datasets usually come from actual observations obtained by sampling a statistical population, and each row corresponds to the observations on one element of that population. Datasets may further be generated by algorithms for the purpose of testing certain kinds of software. Some modern statistical analysis software such as SPSS still present their data in the classical dataset fashion. If data is missing or suspicious an imputation method may be used to complete a data set.[2]

Classic datasets

Several classic datasets have been used extensively in the statistical literature:

  • Iris flower data set - multivariate dataset introduced by Ronald Fisher (1936).[3]
  • MNIST database - Images of handwritten digits commonly used to test classification, clustering, and image processing algorithms
  • Categorical data analysis - Datasets used in the book, An Introduction to Categorical Data Analysis.
  • Robust statistics - Datasets used in Robust Regression and Outlier Detection (Rousseeuw and Leroy, 1986). Provided on-line at the University of Cologne.
  • Time series - Data used in Chatfield's book, The Analysis of Time Series, are provided on-line by StatLib.
  • Extreme values - Data used in the book, An Introduction to the Statistical Modeling of Extreme Values are a snapshot of the data as it was provided on-line by Stuart Coles, the book's author.
  • Bayesian Data Analysis - Data used in the book are provided on-line by Andrew Gelman, one of the book's authors.
  • The Bupa liver data, used in several papers in the machine learning (data mining) literature.
  • Anscombe's quartet Small dataset illustrating the importance of graphing the data to avoid statistical fallacies

See also

Notes

  1. ^
  2. ^
  3. ^

External links

  • UCI - A machine learning repository
  • Datahub - A community-managed home for open datasets
  • Research Pipeline - A wiki/website with links to datasets on many different topics.
  • StatLib--Datasets Archive
  • StatLib--JASA Data Archive
  • Relational dataset repository
  • Data.gov
  • UK Government Public Data
  • GCMD - The Global Change Master Directory contains more than 20,000 descriptions of Earth science datasets and services covering all aspects of Earth and environmental sciences.
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.