It's unavoidable to have to try a lot of resamplers, every voice is unique and resamplers can be individually picky with certain frequencies or traits or specific microphones. There's no way to be certain you will get the right sound out of a VB unless you try as many as you can stomach.
+1 to vlbonnies answer, though, otherwise.