Data set

From HandWiki
Short description: Collection of data
Various plots of the multivariate dataset Iris flower data set introduced by Ronald Fisher (1936).[1]

A data set (or dataset) is a collection of data. In the case of tabular data, a data set corresponds to one or more database tables, where every column of a table represents a particular variable, and each row corresponds to a given record of the data set in question. The data set lists values for each of the variables, such as for example height and weight of an object, for each member of the data set. Data sets can also consist of a collection of documents or files.[2]

In the open data discipline, data set is the unit to measure the information released in a public open data repository. The European data.europa.eu portal aggregates more than a million data sets.[3]

Properties

Several characteristics define a data set's structure and properties. These include the number and types of the attributes or variables, and various statistical measures applicable to them, such as standard deviation and kurtosis.[4]

The values may be numbers, such as real numbers or integers, for example representing a person's height in centimeters, but may also be nominal data (i.e., not consisting of numerical values), for example representing a person's ethnicity. More generally, values may be of any of the kinds described as a level of measurement. For each variable, the values are normally all of the same kind. Missing values may exist, which must be indicated somehow.

In statistics, data sets usually come from actual observations obtained by sampling a statistical population, and each row corresponds to the observations on one element of that population. Data sets may further be generated by algorithms for the purpose of testing certain kinds of software. Some modern statistical analysis software such as SPSS still present their data in the classical data set fashion. If data is missing or suspicious an imputation method may be used to complete a data set.[5]

Classics

Several classic data sets have been used extensively in the statistical literature:

See also

References

  1. 1.0 1.1 Fisher, R.A. (1963). "The Use of Multiple Measurements in Taxonomic Problems". Annals of Eugenics 7 (2): 179–188. doi:10.1111/j.1469-1809.1936.tb02137.x. http://digital.library.adelaide.edu.au/coll/special//fisher/138.pdf. Retrieved 2007-05-22. 
  2. Snijders, C.; Matzat, U.; Reips, U.-D. (2012). "'Big Data': Big gaps of knowledge in the field of Internet". International Journal of Internet Science 7: 1–5. http://www.ijis.net/ijis7_1/ijis7_1_editorial.html. Retrieved 2017-02-10. 
  3. "European open data portal". European Commission. http://www.europeandataportal.eu/data/en/dataset. 
  4. Jan M. Żytkow, Jan Rauch (2000). Principles of data mining and knowledge discovery. Springer. ISBN 978-3-540-66490-1. https://books.google.com/books?id=uTzeRZFmaBgC&pg=PA100. 
  5. United Nations Statistical Commission; United Nations Economic Commission for Europe (2007). Statistical Data Editing: Impact on Data Quality: Volume 3 of Statistical Data Editing, Conference of European Statisticians Statistical standards and studies. United Nations Publications. p. 20. ISBN 978-9211169522. https://books.google.com/books?id=X0wtLo2XY9gC. Retrieved 19 July 2015. [yes|permanent dead link|dead link}}]
  6. "UCI Machine Learning Repository: Iris Data Set". https://archive.ics.uci.edu/ml/datasets/Iris. 
  7. "Textbook Examples An Introduction to Categorical Data Analysis by Alan Agresti". https://stats.oarc.ucla.edu/other/examples/icda/. 
  8. "The ROUSSEEUW datasets". http://www.uni-koeln.de/themen/statistik/data/rousseeuw/. 
  9. "StatLib :: Data, Software and News from the Statistics Community". http://lib.stat.cmu.edu/modules.php?op=modload&name=PostWrap&file=index&page=datasets/. 

External links