Ablation (artificial intelligence)
In artificial intelligence (AI), particularly machine learning (ML),[1] ablation is the removal of a component of an AI system. An ablation study investigates the performance of an AI system by removing certain components to understand the contribution of the component to the overall system.[2]
The term is an analogy with biology (removal of components of an organism), and is particularly used in the analysis of artificial neural nets by analogy with ablative brain surgery.[3] Other analogies include other neuroscience biological systems such as Drosophilla central nervous system and the vertebrate brain.
Ablation studies require that a system exhibit graceful degradation: the system must continue to function even when certain components are missing or degraded.[4] According to some researchers, ablation studies have been deemed a convenient technique in investigating artificial intelligence and its durability to structural damages.[5]
Ablation studies damage and/or remove certain components in a controlled setting to investigate all possible outcomes of system failure; this characterizes how each action impacts the system's overall performance and capabilities. The ablation process can be used to test systems that perform tasks such as speech recognition, visual object recognition, and robot control.[6]
In recent years dedicated frameworks have been developed for performing ablation studies of deep neural networks, including AutoAblation and ABLATOR.[7][8]
History
The term is credited to Allen Newell,[9] one of the founders of artificial intelligence, who used it in his 1974 tutorial on speech recognition, published in (Newell 1975). The term is by analogy with ablation in biology. The motivation was that, while individual components are engineered, the contribution of an individual component to the overall system performance is not clear; removing components allows this analysis.[4]
Newell compared the human brain to artificial computers. With this in thought, Newell saw both as knowledge systems whereas procedures such as ablation can be performed on both to test certain hypotheses.
See also
References
- ↑ "http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1349978" (in en). DIVA. https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1349978&dswid=-4337.
- ↑ Sheikholeslami, Sina (2019). Ablation Programming for Machine Learning. https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-258413.
- ↑ Meyes, Richard; Lu, Melanie; de Puiseau, Constantin Waubert; Meisen, Tobias (24 January 2019). "Ablation Studies in Artificial Neural Networks". arXiv:1901.08644 [cs.NE].
- ↑ 4.0 4.1 Newell 1975.
- ↑ Meyes, Richard; Lu, Melanie; Constantin Waubert de Puiseau; Meisen, Tobias (2019). "Ablation Studies in Artificial Neural Networks". arXiv:1901.08644 [cs.NE].
- ↑ "Ablation Studies to Uncover Structure of Learned Representations in Artificial Neural Networks". https://www.proquest.com/openview/33fb568d0ebec9c44c702393b0c214d7/1?cbl=1976349&pq-origsite=gscholar.
- ↑ Sheikholeslami, Sina; Meister, Moritz; Wang, Tianze; Payberah, Amir H.; Vlassov, Vladimir; Dowling, Jim (2021-04-26). "AutoAblation: Automated Parallel Ablation Studies for Deep Learning". Proceedings of the 1st Workshop on Machine Learning and Systems. EuroMLSys '21. New York, NY, USA: Association for Computing Machinery. pp. 55–61. doi:10.1145/3437984.3458834. ISBN 978-1-4503-8298-4. https://doi.org/10.1145/3437984.3458834.
- ↑ Fostiropoulos, Iordanis; Itti, Laurent (2023-08-15). "ABLATOR: Robust Horizontal-Scaling of Machine Learning Ablation Experiments" (in en). Openreview. https://openreview.net/forum?id=eBLV3i7PG1c.
- ↑ Cohen & Howe 1988, p. 40, Ablation and substitution studies..
Further reading
- Cohen, Paul R.; Howe, Adele E. (1988-12-15). "How Evaluation Guides AI Research: The Message Still Counts More than the Medium". AI Magazine 9 (4): 35–43. doi:10.1609/aimag.v9i4.952. ISSN 2371-9621. https://www.aaai.org/ojs/index.php/aimagazine/article/view/952.
- Seitz, Julien; Durdez, Théophile Mohr; Albenque, Jean P.; Pisapia, André; Gitenay, Edouard; Durand, Cyril; Monteau, Jacques; Moubarak, Ghassan et al. (November 2022). "Artificial intelligence software standardizes electrogram‐based ablation outcome for persistent atrial fibrillation" (in en). Journal of Cardiovascular Electrophysiology 33 (11): 2250–2260. doi:10.1111/jce.15657. ISSN 1045-3873. PMC 9826214. https://onlinelibrary.wiley.com/doi/abs/10.1111/jce.15657.
- D. Raj Reddy, ed (1975). "A Tutorial on Speech Understanding Systems". In Speech Recognition: Invited Papers Presented at the 1974 IEEE Symposium. New York: Academic. p. 43.
 |  |
