Zipper Loss Is Our Gain