Lower the off vocal. Often the reason that they're so loud is because they're mastered. Sometimes you'll be able to find producers distributing unmastered off vocals. (Like NeapolitaN)
It'll all be very quiet, but you can easily bring the volume back up in the end with some normalization on the master.