Curvy Confidence: Embrace the Whale Tail Effect