Tracing sources of epistemic uncertainty in deep learning predictions: homo- and hetero-scedastic linearized estimators
Pierre Nodet, Thomas George
cs.LG stat.ML
Abstract
We adapt two classical statistical estimators for quantifying uncertainty to modern deep learning, in order to provide clearer insights into uncertainty attributable to two sources : aleatoric uncertainty, or locally scarce data. Our approach leverages recent advances in approximate Fisher Information Matrices, to enable scaling to actual architectures. Experimental results demonstrate how each test points is differentially impacted by both sources, highlighting the practical utility of our estimators in improving the robustness of real-world applications.
Topics
Classified with taxonomy v2 on Sat, 5 Sept 2026.