Fluid Vocal Synthesis System: UTAU .NET front-end

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
xIM9ItS.png


FVSS is essentially an alternative to Utau. It is a frontend (main UI of Utau) and a new wavtool (called wavMOD). It still uses standard Utau resamplers, but will be distributed with a World-based resampler (as they are open source), removing the dependency on Utau completely. At the moment it only supports CV and some CVVC banks, and only those with Romaji encoding (as shift-JIS does **NOT** work with FVSS, it's the Utau locale issue but backwards). It supports fresamp, TIPS, and w4u. Others may work, but Utau's default resampler does NOT.

Currently, there is no ability to blend notes (crossfading) or to control pitch besides what key each note will land on. Notes also cannot be moved left and right just yet (but can be moved up and down and resized). There also isn't any way to open projects, or import a .ust or MIDI. You can however save projects, and I recommend you do that anyway because you might be able to open them in the future.

So go ahead, give it a try! You can download the latest version at http://fluidvocalsynth.weebly.com

This is a project I've been working on lately. Essentially what it will be is a replacement for two things: the main UI of Utau (the frontend, main project), and wavtool.exe (using a custom replacement for future features). It is written in C# and will be distributed under an open-source licence (likely MIT or BSD license).

As of now, the project has no GUI, just a command line interface as the guts are developed:
TK5w5Qz.png


Right now it cannot use any resampler other than the Utau default one. Also, the custom wav splicer is not finished, so render results are very choppy due to lack of volume envelopes.

If you would like to help, what I need right now is a WPF piano roll to use for the GUI, as the lack of one is the reason I'm still using the command-line interface. Another thing that needs a lot of help is the wav splicer. As I mentioned earlier, it cannot add envelopes to the renders, nor can it overlap files.

Binary download link will be posted soon, and I'll have the source code up on GitHub some time.

EDIT: If you are looking for binary builds, please download the build on my latest posts here and NOT the one on the 5/25 post!
 
Last edited:

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
UPDATE 5/25/15:
It does indeed work with fresamp! The problem was that the pitch must be written in capital letters (e.g. C#4 is correct, c#4 is wrong)

Also, I've attached a testing build to mess around with. The source code isn't up yet, but I'm working on it!
 

Attachments

  • FVSS_TESTING.zip
    198.1 KB · Views: 27

Buck

Ruko's Ruffians
Supporter
Defender of Defoko
Looks awesome! Ive been learning C# recently, so I found the source code very interesting (insert creepy smile since there isnt one)

Cant wait to see how this turns out. Best of luck!
 

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
Looks awesome! Ive been learning C# recently, so I found the source code very interesting (insert creepy smile since there isnt one)

Cant wait to see how this turns out. Best of luck!
Wow, nice to see somebody's interested!
 
  • Like
Reactions: Buck

Chianachini

Ruko's Ruffians
Defender of Defoko
:creepy: Yup, I haven't been able to take a look because of internet issues, but this sounds really cool! Best of luck~
 

Tema

Living Katsudon
Supporter
Defender of Defoko
I'm interested but I have zero programming experience and therefore look at source code and get scared lol orz
 

Agentzap0

Momo's Minion
no more ugly UTAU!
some questions:
Is it possible to get rid of rests, or make them optional?
Is it possible to get rid of having to wait for the resampler to render?
Multilingual compatibility?
Possibly do what presamp does, but built in? Maybe with extra oto parameters! I want ending consonants to work properly
EDIT: Higher res VB pictures?
 

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
no more ugly UTAU!
some questions:
Is it possible to get rid of rests, or make them optional?
Is it possible to get rid of having to wait for the resampler to render?
Multilingual compatibility?
Possibly do what presamp does, but built in? Maybe with extra oto parameters! I want ending consonants to work properly
EDIT: Higher res VB pictures?
  • Yes! no more ugly utau!
  • Rests will be eliminated for sure (I hate them with a passion)
  • Render wait times will still be there, for now.
  • It's being designed for English use by default (might even use a dictionary), but other languages should be easy to add
  • Someday I hope to replace the standard oto.ini with a custom XML based file with Fluid-specific params, but end consonants would take a lot of working on to get right
  • There will be no voicebank pictures on the main GUI like Utau has. But you may be able to see a picture along with voicebank information in a submenu somewhere
I hope this clears things up. But remember, no GUI has been made yet, so these are just ideas, and these ides are bound to change.
 
  • Like
Reactions: Buck

Buck

Ruko's Ruffians
Supporter
Defender of Defoko
  • Yes! no more ugly utau!
  • Rests will be eliminated for sure (I hate them with a passion)
  • Render wait times will still be there, for now.
  • It's being designed for English use by default (might even use a dictionary), but other languages should be easy to add
  • Someday I hope to replace the standard oto.ini with a custom XML based file with Fluid-specific params, but end consonants would take a lot of working on to get right
  • There will be no voicebank pictures on the main GUI like Utau has. But you may be able to see a picture along with voicebank information in a submenu somewhere
I hope this clears things up. But remember, no GUI has been made yet, so these are just ideas, and these ides are bound to change.


+1 for eliminating rests. What plans in general do you have for the piano roll (note placement/editing amd such)?
 

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
I really don't have to much plans for the details of the piano roll except that it should be easy to use. Right now the plans for the piano roll are:
  1. Make a piano roll work.
That's about it for now. But if you have ideas, please let me know!
 

Buck

Ruko's Ruffians
Supporter
Defender of Defoko
Hey, that works. One feature that might be useful would be to make it so that notes are expandable from both ends as opposed to only being expandable from the right. If you drag a note out to the point where it overlaps another note, the other note shortens itself from that respective end to accomodate the newly expanded one.

But of course, thats only after you have a working piano roll. Also if thats not gonna work just ignore me lol. I just think of random stuff and say "hey i bet it would be cool if.." So :/
 

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
Hey, that works. One feature that might be useful would be to make it so that notes are expandable from both ends as opposed to only being expandable from the right. If you drag a note out to the point where it overlaps another note, the other note shortens itself from that respective end to accomodate the newly expanded one.

But of course, thats only after you have a working piano roll. Also if thats not gonna work just ignore me lol. I just think of random stuff and say "hey i bet it would be cool if.." So :/
That was indeed part of my idea. The lack of this kind of editing as part of the reason Utau sucks so bad. Speaking of Utau sucking, here's some of the features that made me want to start Fluid in the first place:
  • Terrible looking GUI, looks like a bad throwback from 1992
  • Nasty piano roll
  • Having to use rests instead of just moving the note (like every other editor on the planet)
  • Terrible pitch editors, terrible envelope editors
  • Shift-JIS (aka "I gotta set my local to Japan to use this software")
  • Lack of English voicebank support (well decent support, anyway)
  • Mediocre keyboard shortcuts (I like to use my keyboard for EVERYTHING)
  • Command-line windows popping up in your face every time you render
And that's the tip of the iceberg. Utau is cool and all, but from a software standpoint, the program itself is pretty crappy. I just thought that I could improve on it a bit myself, as well as offer an open-source solution.
 

Chianachini

Ruko's Ruffians
Defender of Defoko
/support for more possible keyboard shortcuts
It's easy to find an alternative, but would it be possible to add a tone (either piano or a vb sample) whenever a key on the piano roll is pressed like some editors?
 

Buck

Ruko's Ruffians
Supporter
Defender of Defoko
/support for more possible keyboard shortcuts
It's easy to find an alternative, but would it be possible to add a tone (either piano or a vb sample) whenever a key on the piano roll is pressed like some editors?

You can do this in the main editor by going to Tools>Option>MIDI, and under the MIDI OUT section, click on the dropdown box and select Microsoft GS Wavetable Synth. Then, make sure the MIDI out Icon is clicked, and you can click on keys amd they will play a piano sound with the pitch you are on.
 

Chianachini

Ruko's Ruffians
Defender of Defoko
You can do this in the main editor by going to Tools>Option>MIDI, and under the MIDI OUT section, click on the dropdown box and select Microsoft GS Wavetable Synth. Then, make sure the MIDI out Icon is clicked, and you can click on keys amd they will play a piano sound with the pitch you are on.

Ohmagosh I had no idea! Guess I didn't wanna dwell too deep into the settings, so thanks a bunch!
 

Buck

Ruko's Ruffians
Supporter
Defender of Defoko
Ohmagosh I had no idea! Guess I didn't wanna dwell too deep into the settings, so thanks a bunch!
No Problem! It is kinda strange that it isn't on by default...

That was indeed part of my idea. The lack of this kind of editing as part of the reason Utau sucks so bad. Speaking of Utau sucking, here's some of the features that made me want to start Fluid in the first place:
  • Terrible looking GUI, looks like a bad throwback from 1992
  • Nasty piano roll
  • Having to use rests instead of just moving the note (like every other editor on the planet)
  • Terrible pitch editors, terrible envelope editors
  • Shift-JIS (aka "I gotta set my local to Japan to use this software")
  • Lack of English voicebank support (well decent support, anyway)
  • Mediocre keyboard shortcuts (I like to use my keyboard for EVERYTHING)
  • Command-line windows popping up in your face every time you render
And that's the tip of the iceberg. Utau is cool and all, but from a software standpoint, the program itself is pretty crappy. I just thought that I could improve on it a bit myself, as well as offer an open-source solution.
Yeah, the GUI does look pretty outdated (lol unedited windows form elements). The command line thing sort of scared me at first, I thought the program was crashing XD.
 

CarrotJuice

Ruko's Ruffians
Defender of Defoko
this project looks sooo awesome omg very exited for the results keep up the work well done ^_^
 

KNΞMΛTCS

Just an UtaForum user
Defender of Defoko
Thread starter
UPDATE 6/3/2015:
Fluid now has it's own file, .FVSP! as of now, you can take a look at the file structure by creating a project in the console and using the command save <flileLocation> to save the file. You can then read it with a text editor (it's XML based). As of now there's no way to open these files yet.

Also, I've just started to work on a piano roll! Here's what I've made so far:
xMXF1Ml.png

As of now all it's just a bunch of useless note lanes, I hope to add some more functionality in the next build!

As for build, I've attached a binary of build 4 here:
 

Attachments

  • FVSS_TESTING4.zip
    208.8 KB · Views: 21

Similar threads