When the Only Thing That Matters is Your Layers