|Machine learning and|
Data science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from noisy, structured and unstructured data, and apply knowledge and actionable insights from data across a broad range of application domains. Data science is related to data mining, machine learning and big data.
Data science is a "concept to unify statistics, data analysis, informatics, and their related methods" in order to "understand and analyze actual phenomena" with data. It uses techniques and theories drawn from many fields within the context of mathematics, statistics, computer science, information science, and domain knowledge. However, data science is different from computer science and information science. Turing Award winner Jim Gray imagined data science as a "fourth paradigm" of science (empirical, theoretical, computational, and now data-driven) and asserted that "everything about science is changing because of the impact of information technology" and the data deluge.
A data scientist is someone who creates programming code and combines it with statistical knowledge to create insights from data.
Data science is an interdisciplinary field focused on extracting knowledge from data sets, which are typically large (see big data), and applying the knowledge and actionable insights from data to solve problems in a wide range of application domains. The field encompasses preparing data for analysis, formulating data science problems, analyzing data, developing data-driven solutions, and presenting findings to inform high-level decisions in a broad range of application domains. As such, it incorporates skills from computer science, statistics, information science, mathematics, data visualization, information visualization, data sonification, data integration, graphic design, complex systems, communication and business. Statistician Nathan Yau, drawing on Ben Fry, also links data science to human–computer interaction: users should be able to intuitively control and explore data. In 2015, the American Statistical Association identified database management, statistics and machine learning, and distributed and parallel systems as the three emerging foundational professional communities.
Relationship to statistics
Many statisticians, including Nate Silver, have argued that data science is not a new field, but rather another name for statistics. Others argue that data science is distinct from statistics because it focuses on problems and techniques unique to digital data. Vasant Dhar writes that statistics emphasizes quantitative data and description. In contrast, data science deals with quantitative and qualitative data (e.g. images) and emphasizes prediction and action. Andrew Gelman of Columbia University has described statistics as a nonessential part of data science. Stanford professor David Donoho writes that data science is not distinguished from statistics by the size of datasets or use of computing, and that many graduate programs misleadingly advertise their analytics and statistics training as the essence of a data-science program. He describes data science as an applied field growing out of traditional statistics. In summary, data science can be therefore described as an applied branch of statistics.
In 1962, John Tukey described a field he called "data analysis", which resembles modern data science. In 1985, in a lecture given to the Chinese Academy of Sciences in Beijing, C. F. Jeff Wu used the term "data science" for the first time as an alternative name for statistics. Later, attendees at a 1992 statistics symposium at the University of Montpellier II acknowledged the emergence of a new discipline focused on data of various origins and forms, combining established concepts and principles of statistics and data analysis with computing.
The term "data science" has been traced back to 1974, when Peter Naur proposed it as an alternative name for computer science. In 1996, the International Federation of Classification Societies became the first conference to specifically feature data science as a topic. However, the definition was still in flux. After the 1985 lecture in the Chinese Academy of Sciences in Beijing, in 1997 C. F. Jeff Wu again suggested that statistics should be renamed data science. He reasoned that a new name would help statistics shed inaccurate stereotypes, such as being synonymous with accounting, or limited to describing data. In 1998, Hayashi Chikio argued for data science as a new, interdisciplinary concept, with three aspects: data design, collection, and analysis.
The modern conception of data science as an independent discipline is sometimes attributed to William S. Cleveland. In a 2001 paper, he advocated an expansion of statistics beyond theory into technical areas; because this would significantly change the field, it warranted a new name. "Data science" became more widely used in the next few years: in 2002, the Committee on Data for Science and Technology launched Data Science Journal. In 2003, Columbia University launched The Journal of Data Science. In 2014, the American Statistical Association's Section on Statistical Learning and Data Mining changed its name to the Section on Statistical Learning and Data Science, reflecting the ascendant popularity of data science.
The professional title of "data scientist" has been attributed to DJ Patil and Jeff Hammerbacher in 2008. Though it was used by the National Science Board in their 2005 report "Long-Lived Digital Data Collections: Enabling Research and Education in the 21st Century", it referred broadly to any key role in managing a digital data collection.
There is still no consensus on the definition of data science, and it is considered by some to be a buzzword. Big data is a related marketing term. Data scientists are responsible for breaking down big data into usable information and creating software and algorithms that help companies and organizations determine optimal operations.
Technologies and techniques
There is a variety of different technologies and techniques that are used for data science, depending on the application.
- Linear regression
- Logistic regression
- Decision trees are used as prediction models for classification and data fitting. The decision tree structure can be used to generate rules able to classify or predict target/class/label variable based on the observation attributes.
- Support-vector machine (SVM)
- Cluster analysis is a technique used to group data together.
- Dimensionality reduction is used to reduce the complexity of data computation so that it can be performed more quickly.
- Machine learning is a technique used to perform tasks by inferencing patterns from data.
- Naive Bayes classifiers are used to classify by applying the Bayes' theorem. They are mainly used in datasets with large amounts of data and can aptly generate accurate results.
- International Journal of Population Data Science
- Dhar, V. (2013). "Data science and prediction". Communications of the ACM 56 (12): 64–73. doi:10.1145/2500499. http://cacm.acm.org/magazines/2013/12/169933-data-science-and-prediction/fulltext. Retrieved 2 September 2015.
- Jeff Leek (2013-12-12). "The key word in "Data Science" is not Data, it is Science". Simply Statistics. http://simplystatistics.org/2013/12/12/the-key-word-in-data-science-is-not-data-it-is-science/.
- Hayashi, Chikio (1998-01-01). "What is Data Science? Fundamental Concepts and a Heuristic Example". in Hayashi, Chikio (in en). Data Science, Classification, and Related Methods. Studies in Classification, Data Analysis, and Knowledge Organization. Springer Japan. pp. 40–51. doi:10.1007/978-4-431-65950-1_3. ISBN 9784431702085. https://www.springer.com/book/9784431702085.
- Cao, Longbing (2017-06-29). "Data Science: A Comprehensive Overview". ACM Computing Surveys 50 (3): 43:1–43:42. doi:10.1145/3076253. ISSN 0360-0300.
- Tony Hey; Stewart Tansley; Kristin Michele Tolle (2009). The Fourth Paradigm: Data-intensive Scientific Discovery. Microsoft Research. ISBN 978-0-9825442-0-4. https://books.google.com/books?id=oGs_AQAAIAAJ.
- Bell, G.; Hey, T.; Szalay, A. (2009). "COMPUTER SCIENCE: Beyond the Data Deluge". Science 323 (5919): 1297–1298. doi:10.1126/science.1170411. ISSN 0036-8075. PMID 19265007.
- Davenport, Thomas H.; Patil, D. J. (October 2012). "Data Scientist: The Sexiest Job of the 21st Century". Harvard Business Review 90 (10): 70–76, 128. PMID 23074866. https://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/. Retrieved 2016-01-18.
- "About Data Science". http://www.datascienceassn.org/about-data-science.
- "1. Introduction: What Is Data Science?" (in en). Doing Data Science [Book]. O’Reilly. https://www.oreilly.com/library/view/doing-data-science/9781449363871/ch01.html.
- "the three sexy skills of data geeks" (in en). 27 May 2009. https://medriscoll.com/post/4740157098/the-three-sexy-skills-of-data-geeks.
- Yau, Nathan (2009-06-04). "Rise of the Data Scientist" (in en). https://flowingdata.com/2009/06/04/rise-of-the-data-scientist/.
- "Basic Example". https://benfry.com/phd/dissertation/2.html.
- "ASA Statement on the Role of Statistics in Data Science". American Statistical Association. 2015-10-01. https://magazine.amstat.org/blog/2015/10/01/asa-statement-on-the-role-of-statistics-in-data-science/.
- "Nate Silver: What I need from statisticians". https://www.statisticsviews.com/article/nate-silver-what-i-need-from-statisticians/.
- "What's the Difference Between Data Science and Statistics?" (in en). http://priceonomics.com/whats-the-difference-between-data-science-and/.
- Vasant Dhar (2013-12-01). "Data science and prediction" (in en). Communications of the ACM 56 (12): 64–73. doi:10.1145/2500499.
- "Statistics is the least important part of data science « Statistical Modeling, Causal Inference, and Social Science". https://statmodeling.stat.columbia.edu/2013/11/14/statistics-least-important-part-data-science/.
- Donoho, David (18 September 2015). "50 years of Data Science". http://courses.csail.mit.edu/18.337/2015/docs/50YearsDataScience.pdf.
- Wu, C. F. Jeff (1986). "Future directions of statistical research in China: a historical perspective". Application of Statistics and Management 1: 1–7. https://www2.isye.gatech.edu/~jeffwu/publications/fazhan.pdf. Retrieved 29 November 2020.
- Data science and its applications. Tokyo: Academic Press/Harcourt Brace. 1995. ISBN 0-12-241770-4. OCLC 489990740.
- Murtagh, Fionn; Devlin, Keith (2018). "The Development of Data Science: Implications for Education, Employment, Research, and the Data Revolution for Sustainable Development" (in en). Big Data and Cognitive Computing 2 (2): 14. doi:10.3390/bdcc2020014.
- CaoLongbing (2017-06-29). "Data Science" (in en). ACM Computing Surveys 50 (3): 1–42. doi:10.1145/3076253.
- Wu, C. F. Jeff. "Statistics=Data Science?". http://www2.isye.gatech.edu/~jeffwu/presentations/datascience.pdf.
- Press, Gil. "A Very Short History of Data Science" (in en). https://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science/.
- Gupta, Shanti (11 December 2015). "William S. Cleveland". https://www.stat.purdue.edu/~wsc/.
- Talley, Jill (1 June 2016). "ASA Expands Scope, Outreach to Foster Growth, Collaboration in Data Science". Amstat News (American Statistical Association). https://magazine.amstat.org/blog/2016/06/01/datascience-2/.
- Davenport, Thomas H.; Patil, D. J. (2012-10-01). "Data Scientist: The Sexiest Job of the 21st Century". Harvard Business Review (October 2012). ISSN 0017-8012. https://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century.
- "US NSF – NSB-05-40, Long-Lived Digital Data Collections Enabling Research and Education in the 21st Century". https://www.nsf.gov/pubs/2005/nsb0540/.
- Press, Gil. "Data Science: What's The Half-Life of a Buzzword?" (in en). https://www.forbes.com/sites/gilpress/2013/08/19/data-science-whats-the-half-life-of-a-buzzword/.
- Pham, Peter. "The Impacts of Big Data That You May Not Have Heard Of" (in en). https://www.forbes.com/sites/peterpham/2015/08/28/the-impacts-of-big-data-that-you-may-not-have-heard-of/.
- Martin, Sophia (2019-09-20). "How Data Science will Impact Future of Businesses?" (in en). https://towardsdatascience.com/how-data-science-will-impact-future-of-businesses-7f11f5699c4d.
Original source: https://en.wikipedia.org/wiki/Data science. Read more