For quad-bayer, I’ve found that the higher MP count images are basically indistinguishable from the 1/4th resolution, so they carry a massive file-size and processing memory penalty for really no measurable benefit since they’re not resolving any more real detail.
You should try an A/B test locally with a small dataset (20 images or so) and see if you can see any difference or not.