I think Charles would get along well with Jean Valjean - not because they're alike, but because Valjean is obviously a mutant and they have similar outlooks about using their money to help people. He'd just have to get Valjean past the extreme self-sacrifice part. Meanwhile, Magneto would pitch Javert head first into the Seine.