You could use electrolysis to clean them up. It works wonders if you have plenty of timeConsidering how rusty my calipers are I am going to try an experiment that has worked well for me in the past on bike parts.
I'm going to leave the calipers and holders to soak in an oxalic acid bath for a few days. I shall report back on success/failure.