Well, have you reconsidered kind of keeping your voice natural when recording? Sometimes if you exaggerate the tone, results can be oddly experimental.
You have to ensure when recording the voicebank, every one of the recordings isn't one pitch higher or lower.
Note you do NOT have to sing to...