> Is there a way to remove the duplicate header in Postfix?

it might (should) be possible with a milter

> Alternatively, is it possible to remove the MIME-Version header(s)
> altogether? Would this break the message (or the mail client from
> the recipient)?

it depends, it might break things

if possible i would look to see why you have a duplicate header and
address things there