Fluid Vocal Synthesis System: UTAU .NET front-end

Discussion in 'UTAU Discussion' started by KNΞMΛTCS, May 24, 2015.

  1. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    [​IMG]

    FVSS is essentially an alternative to Utau. It is a frontend (main UI of Utau) and a new wavtool (called wavMOD). It still uses standard Utau resamplers, but will be distributed with a World-based resampler (as they are open source), removing the dependency on Utau completely. At the moment it only supports CV and some CVVC banks, and only those with Romaji encoding (as shift-JIS does **NOT** work with FVSS, it's the Utau locale issue but backwards). It supports fresamp, TIPS, and w4u. Others may work, but Utau's default resampler does NOT.

    Currently, there is no ability to blend notes (crossfading) or to control pitch besides what key each note will land on. Notes also cannot be moved left and right just yet (but can be moved up and down and resized). There also isn't any way to open projects, or import a .ust or MIDI. You can however save projects, and I recommend you do that anyway because you might be able to open them in the future.

    So go ahead, give it a try! You can download the latest version at http://fluidvocalsynth.weebly.com

    This is a project I've been working on lately. Essentially what it will be is a replacement for two things: the main UI of Utau (the frontend, main project), and wavtool.exe (using a custom replacement for future features). It is written in C# and will be distributed under an open-source licence (likely MIT or BSD license).

    As of now, the project has no GUI, just a command line interface as the guts are developed:
    [​IMG]

    Right now it cannot use any resampler other than the Utau default one. Also, the custom wav splicer is not finished, so render results are very choppy due to lack of volume envelopes.

    If you would like to help, what I need right now is a WPF piano roll to use for the GUI, as the lack of one is the reason I'm still using the command-line interface. Another thing that needs a lot of help is the wav splicer. As I mentioned earlier, it cannot add envelopes to the renders, nor can it overlap files.

    Binary download link will be posted soon, and I'll have the source code up on GitHub some time.

    EDIT: If you are looking for binary builds, please download the build on my latest posts here and NOT the one on the 5/25 post!
     
    Last edited: Jan 27, 2016
    Dekpi, Zircon, FluoroLime and 4 others like this.
  2.  
  3. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    UPDATE 5/25/15:
    It does indeed work with fresamp! The problem was that the pitch must be written in capital letters (e.g. C#4 is correct, c#4 is wrong)

    Also, I've attached a testing build to mess around with. The source code isn't up yet, but I'm working on it!
     

    Attached Files:

  4. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
  5. Buck

    Buck Ruko's Ruffians Supporter Defender of Defoko

    Messages
    80
    Likes Received
    171
    Trophy Points
    38
    Looks awesome! Ive been learning C# recently, so I found the source code very interesting (insert creepy smile since there isnt one)

    Cant wait to see how this turns out. Best of luck!
     
  6. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    Wow, nice to see somebody's interested!
     
    Buck likes this.
  7. Chianachini

    Chianachini Ruko's Ruffians Defender of Defoko

    Messages
    97
    Likes Received
    108
    Trophy Points
    48
    :creepy: Yup, I haven't been able to take a look because of internet issues, but this sounds really cool! Best of luck~
     
  8. Tema

    Tema Living Katsudon Supporter Defender of Defoko

    Messages
    315
    Likes Received
    257
    Trophy Points
    86
    I'm interested but I have zero programming experience and therefore look at source code and get scared lol orz
     
  9. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    But you can still help! You can still come up with ideas, and of course you can try out builds!
     
    JVウタウ and Tema like this.
  10. Agentzap0

    Agentzap0 Momo's Minion

    Messages
    19
    Likes Received
    12
    Trophy Points
    7
    no more ugly UTAU!
    some questions:
    Is it possible to get rid of rests, or make them optional?
    Is it possible to get rid of having to wait for the resampler to render?
    Multilingual compatibility?
    Possibly do what presamp does, but built in? Maybe with extra oto parameters! I want ending consonants to work properly
    EDIT: Higher res VB pictures?
     
  11. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    • Yes! no more ugly utau!
    • Rests will be eliminated for sure (I hate them with a passion)
    • Render wait times will still be there, for now.
    • It's being designed for English use by default (might even use a dictionary), but other languages should be easy to add
    • Someday I hope to replace the standard oto.ini with a custom XML based file with Fluid-specific params, but end consonants would take a lot of working on to get right
    • There will be no voicebank pictures on the main GUI like Utau has. But you may be able to see a picture along with voicebank information in a submenu somewhere
    I hope this clears things up. But remember, no GUI has been made yet, so these are just ideas, and these ides are bound to change.
     
    Buck likes this.
  12. Buck

    Buck Ruko's Ruffians Supporter Defender of Defoko

    Messages
    80
    Likes Received
    171
    Trophy Points
    38

    +1 for eliminating rests. What plans in general do you have for the piano roll (note placement/editing amd such)?
     
  13. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    I really don't have to much plans for the details of the piano roll except that it should be easy to use. Right now the plans for the piano roll are:
    1. Make a piano roll work.
    That's about it for now. But if you have ideas, please let me know!
     
  14. Buck

    Buck Ruko's Ruffians Supporter Defender of Defoko

    Messages
    80
    Likes Received
    171
    Trophy Points
    38
    Hey, that works. One feature that might be useful would be to make it so that notes are expandable from both ends as opposed to only being expandable from the right. If you drag a note out to the point where it overlaps another note, the other note shortens itself from that respective end to accomodate the newly expanded one.

    But of course, thats only after you have a working piano roll. Also if thats not gonna work just ignore me lol. I just think of random stuff and say "hey i bet it would be cool if.." So :/
     
  15. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    That was indeed part of my idea. The lack of this kind of editing as part of the reason Utau sucks so bad. Speaking of Utau sucking, here's some of the features that made me want to start Fluid in the first place:
    • Terrible looking GUI, looks like a bad throwback from 1992
    • Nasty piano roll
    • Having to use rests instead of just moving the note (like every other editor on the planet)
    • Terrible pitch editors, terrible envelope editors
    • Shift-JIS (aka "I gotta set my local to Japan to use this software")
    • Lack of English voicebank support (well decent support, anyway)
    • Mediocre keyboard shortcuts (I like to use my keyboard for EVERYTHING)
    • Command-line windows popping up in your face every time you render
    And that's the tip of the iceberg. Utau is cool and all, but from a software standpoint, the program itself is pretty crappy. I just thought that I could improve on it a bit myself, as well as offer an open-source solution.
     
    Oda Hikaru, JVウタウ and Buck like this.
  16. Chianachini

    Chianachini Ruko's Ruffians Defender of Defoko

    Messages
    97
    Likes Received
    108
    Trophy Points
    48
    /support for more possible keyboard shortcuts
    It's easy to find an alternative, but would it be possible to add a tone (either piano or a vb sample) whenever a key on the piano roll is pressed like some editors?
     
  17. Buck

    Buck Ruko's Ruffians Supporter Defender of Defoko

    Messages
    80
    Likes Received
    171
    Trophy Points
    38
    You can do this in the main editor by going to Tools>Option>MIDI, and under the MIDI OUT section, click on the dropdown box and select Microsoft GS Wavetable Synth. Then, make sure the MIDI out Icon is clicked, and you can click on keys amd they will play a piano sound with the pitch you are on.
     
  18. Chianachini

    Chianachini Ruko's Ruffians Defender of Defoko

    Messages
    97
    Likes Received
    108
    Trophy Points
    48
    Ohmagosh I had no idea! Guess I didn't wanna dwell too deep into the settings, so thanks a bunch!
     
  19. Buck

    Buck Ruko's Ruffians Supporter Defender of Defoko

    Messages
    80
    Likes Received
    171
    Trophy Points
    38
    No Problem! It is kinda strange that it isn't on by default...

    Yeah, the GUI does look pretty outdated (lol unedited windows form elements). The command line thing sort of scared me at first, I thought the program was crashing XD.
     
  20. CarrotJuice

    CarrotJuice Ruko's Ruffians Defender of Defoko

    Messages
    160
    Likes Received
    84
    Trophy Points
    32
    this project looks sooo awesome omg very exited for the results keep up the work well done ^_^
     
  21. KNΞMΛTCS

    KNΞMΛTCS Just an UtaForum user Defender of Defoko

    Messages
    333
    Likes Received
    547
    Trophy Points
    115
    UPDATE 6/3/2015:
    Fluid now has it's own file, .FVSP! as of now, you can take a look at the file structure by creating a project in the console and using the command save <flileLocation> to save the file. You can then read it with a text editor (it's XML based). As of now there's no way to open these files yet.

    Also, I've just started to work on a piano roll! Here's what I've made so far:
    [​IMG]
    As of now all it's just a bunch of useless note lanes, I hope to add some more functionality in the next build!

    As for build, I've attached a binary of build 4 here:
     

    Attached Files:

Share This Page