Confidence on the Horizon: A Formal Journey