Depending on the application, the image data must fulfill different requirements. If you take a fast snapshot, you want a ready-to-use image from the camera. The image should look as good as possible and should not require any further postprocessing.
The pixel preprocessing in the camera hardware offers many advantages, in particular for embedded systems. Here, packed color formats, among others, can be used for data transmission.