In QuickTime 5 and earlier, you must check the Allow Transcoding checkbox in order to compress Y'CbCr video with perfect quality.

Otherwise, these older versions of QuickTime will first convert the video to RGB, which degrades the image even though RGB 8b is a higher-quality format than Y'CbCr 8b.