Early-exit network
Early-exit networks are a class of dynamic neural networks designed for efficient inference by allowing models to make confident predictions at intermediate layers, rather than processing the full network.[1]
Early-exit mechanisms are methods for deep neural networks that add intermediate classifiers, allowing inference to stop at earlier layers for inputs assessed as low uncertainty. Decisions to exit are typically based on confidence measures such as softmax-derived scores, classification margins, or entropy-based criteria, with the goal of reducing computational cost. These approaches are commonly paired with specialized training procedures and system-level optimizations to improve efficiency while preserving accuracy.[2]
The main idea behind the technology is to stop excessive calculations when a good answer can already be given with a high degree of probability, which can save both computation and time.[3][4]
Early-exit networks have also been extended with expert-based exit criteria, where intermediate classifiers are treated as multiple “experts” whose predictions and confidence scores can be aggregated to decide whether to stop computation early.[5]
Hardware implementations are also being developed.[6]
See also
References
- ↑ "Early-Exit Deep Neural Network - A Comprehensive Survey" (in en). doi:10.1145/3698767. https://dl.acm.org/doi/full/10.1145/3698767.
- ↑ "Early-Exit Mechanisms in Neural Networks". https://www.emergentmind.com/topics/early-exit-mechanisms.
- ↑ "BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks". https://arxiv.org/abs/1709.01686.
- ↑ "Confidence-gated training for efficient early-exit neural networks". https://arxiv.org/abs/2509.17885.
- ↑ Bajpai, Divya Jyoti; Hanawal, Manjesh Kumar (4 October 2024). "BEEM: Boosting Performance of Early Exit DNNs using Multi-Exit Classifiers as Experts" (in en). https://openreview.net/forum?id=EzrZX9bd4G.
- ↑ Biggs, Benjamin; Bouganis, Christos-Savvas; Constantinides, George (May 2023). "ATHEENA: A Toolflow for Hardware Early-Exit Network Automation". pp. 121–132. doi:10.1109/FCCM57271.2023.00022. https://ieeexplore.ieee.org/abstract/document/10171508.
 |  |
