UTSU - A cross-platform vocal synth frontend

Discussion in 'UTAU Discussion' started by Lethe, Jan 14, 2018.

  1. Lethe

    Lethe Ruko's Ruffians Supporter Defender of Defoko

    Messages
    32
    Likes Received
    184
    Trophy Points
    37
    1) Do you mean the utsu-0.3.zip file on the release page? That's a wrapper for the .jar file, so you can debug it by using the instructions on the README page.
    2) uh oops

    Both of those are scheduled for the 0.4 release!

    Most likely Utsu has a bug and is incompatible with the VCV voicebank you tried. If you were trying to open a published voicebank, can you send me a download link? I can make sure that Utsu's next release is compatible with that voicebank!

    Thanks for all the bug reports! I tried out Meiji's Fantasy voicebank and it was a goldmine of bugs, I found three bugs whle trying to open it. They have all now been fixed! The "double-rendering" issue has been fixed for next update as well.

    The Windows issue you mentioned will be harder to debug since I rarely use Windows, but it seems like the Java VM included with Utsu is interfering somehow with the Java VM already installed on your machine. I'll look into fixing the .wav issue you mentioned as well. Didn't even know that bug existed since I've never tried to export anything longer than a few notes. :<

    Progress report: Utsu is getting a minor update (0.3.1) this weekend. Mostly bug fixes, but there will be a few new UI features and hotkeys as well.

    Also: yay, 100th post!
     
    VocAddict, azazel, Kiyoteru and 6 others like this.
  2. Prehnite

    Prehnite Momo's Minion

    Messages
    1
    Likes Received
    0
    Trophy Points
    4
    Are you going to add in a way to edit multiple sound envelopes at once? Like if someone wanted to reset the sound envelopes of a whole song back to their original crossfades and shapes, but they did not want to have to reset each envelope one by one. Or if someone wanted to change the type of crossfade on multiple sound envelopes at once. Like the five sound envelope crossfade editing buttons in Utau(the ones under the render button). And is an A la Carte menu going to be added to Utsu? I'm sorry if this is confusing and if I asked too many questions.
     
  3. Lethe

    Lethe Ruko's Ruffians Supporter Defender of Defoko

    Messages
    32
    Likes Received
    184
    Trophy Points
    37
    Detailed question deserves detailed answer! I'll cover the five envelope editing buttons in UTAU one-by-one:
    First button: I'm not sure what this one does?
    P2/P3 crossfade: I don't plan on making UTSU support this. The main advantage P2/P3 has over P1/P4 is more control points on the ends of the envelopes instead of the middle, and UTSU discourages modifying the envelopes in this way in the first place. (When parsing a UST with P2/P3 crossfading, UTSU will automatically convert it to P1/P4.)
    P1/P4 crossfade: UTSU does this automatically for all notes, so there's no need for a button for it.
    Optimization: Definitely plan to support this in the future!
    Envelope reset: This will be written as part of the bulk edit tool.

    I am planning on adding a bulk edit menu to UTSU, most likely integrated with the existing Note Properties tool. It's not planned for the upcoming 0.4 release but will likely be part of 0.5.

    As promised, here's the 0.3.1 release! You can go here to find new Windows/Mac installers and a new JAR executable.

    Updates:
    • Quality of life features.
      • Render button replaced with Rewind/Play/Pause/Stop buttons.
      • Status bar added to the bottom of the screen that prints out simple progress/error messages.
      • Progress bar when rendering or exporting to WAV.
      • Opening and saving files will no longer freeze the UI.
      • Rendering is now multi-threaded and should be faster than before.
    • New hotkeys added!
      • Hotkeys on Mac now use CMD instead of CTRL as an accelerator.
      • CTRL-P to open song properties.
      • SPACE to play/pause song. (In voicebank editor, SPACE will play selected oto line, if any.)
      • V to rewind song.
      • B to stop song.
      • Q for ADD mode, W for EDIT mode, E for DELETE mode.
    • New language: Indonesian
      • Translations are a work in progress, not all messages will be translated!
    • Bug fixes.
      • Can no longer start playback while another playback on the same tab is in progress.
      • Playback bar now starts and stops at the right places.
      • Playback bar now moves at the right speed.
      • Can now open voicebanks with an oto.ini but no character.txt file.
      • Removed a few parsing errors in reading USTs.
      • Removed a few parsing errors in reading voicebanks.
    Also, UTSU has an Italian-language user guide now! Thanks, @susrever!

    Future plans:
    Reworking the UI to replace ADD/EDIT/DELETE modes with a single mode that does all three. Also adding some more vital editing features, like Copy/Paste, Undo, and moving multiple notes at once.
     
    Last edited: Sep 1, 2018
  4. Halo

    Halo Icon by Wanpuccino @ DA Administrator Defender of Defoko

    Messages
    464
    Likes Received
    143
    Trophy Points
    63
    Awesome update. Something I've noticed is that if you have a project that starts from the first note on the roll, it won't render out the preutterance "correctly" (that is, accounting for any overlap/preutt that is supposed to play before the beginning of the main part of the first note), resulting in timing issues. I believe VOCALOID has a full note of pre-roll partially to account for this-- the extra note isn't rendered, but any overlapping consonants or leadup into a note are.

    Also, I can't seem to select as usual in this update.
    EDIT: This seems to be caused by me using my tablet, as I normally use that for everything. For whatever reason it's not correctly picking up my taps. It maybe thinks I'm moving my cursor?

    Also a bug (?) seems to have been introduced where if I occlude a note completely (so it is 100% greyed out) then fix the note that overlapped it, the greyed out note will not update to reflect that it is no longer overlapped until I move it back and forth.

    Are there plans to have VOCALOID/UTAU-like selection in the future where you drag on the background to select? I had assumed this was a QoL thing but it wouldn't hurt to ask!

    MORE EDIT: It doesn't read 雷鳴カゲロウ's oto either, for some reason it only reads her vowels? I can't give an indication as to why this would be. Her oto is all there when I open the txt, she has frqs for every file though I'm sure that's not meant to matter, she has a character.txt. It behaves as though there aren't any files in her VB except for あ. she's a pretty basic CV only VB.
     
    Last edited: Sep 1, 2018
    Kiyoteru likes this.
  5. partial

    partial UTAU English advocate Global Mod Supporter Defender of Defoko

    Messages
    1,495
    Likes Received
    2,717
    Trophy Points
    138
    Tried to install UTSU from setup.exe and when I launched it I got this error. upload_2018-9-1_20-23-57.png
    It seems to still be installing regardless. Hopefully it doesn't change anything?

    edit:
    upload_2018-9-1_20-24-47.png
    upload_2018-9-1_20-24-53.png
    upload_2018-9-1_20-25-0.png
     
    Halo likes this.
  6. FiftiesYoungin

    FiftiesYoungin Procrastination Who? Supporter Defender of Defoko

    Messages
    256
    Likes Received
    236
    Trophy Points
    73
  7. Lethe

    Lethe Ruko's Ruffians Supporter Defender of Defoko

    Messages
    32
    Likes Received
    184
    Trophy Points
    37
    Sounds legit, will do.

    This has been a known issue for several months actually! I've put off fixing it so far, but since I'm reworking note movement anyway for the next update I'll be sure to fix this at the same time.

    Yes, that's planned for next update! My current UI spec is:
    click: Un-highlight all.
    click+drag: Add a new note.
    rightclick: Open context menu (for pasting selection or adding new notes).
    rightclick+drag OR shift-click+drag: Highlight selection.
    (Feel free to give suggestions on this by the way! A UI designer I am not.)

    The bug here was that the oto.ini file had nothing for the aliases. UTSU didn't know yet to use the filename as the alias in those cases. This has been fixed for next update!

    I looked up your error code, and according to this StackOverflow post the problem might be that your virus scan is flagging UTSU's installer. So you may want to whitelist "InnoSetup" (the program I used to create the installer) in your virus scan. That or just temporarily disable your scan.

    As for the three JVM errors, someone else has reported the same problem and I still don't know what's causing it ;_;
    It might be fixed if you complete the install without error, but then again it might not... any help on this bug from someone knowledgeable in Windows would be much appreciated!

    Also, as @FiftiesYoungin said, using the JAR file to run UTSU is more reliable because you won't have to worry about installer issues. But you will need to install Java on your computer first using the instructions here.
     
    Halo and partial like this.
  8. Wendi

    Wendi 熊熊 !!! Defender of Defoko

    Messages
    108
    Likes Received
    263
    Trophy Points
    68
    i'm having an issue where a lot of the USTs im loading are having their tempos messed up. I've loaded usts like "Why Can't I Even Dream", and "I can only hear the sound of tears" and the tempos were all set to max and too fast, but if i load them in UTAu Synth its fine, so its not the UST.
    Another issue is that it seems like when I load USTs some note length values are changed because I'm hearing incorrect rhythms. (and again when im loading them in regular UTAU Synth the rhythms are correct)
    A lot of times when the UTAU sings it sounds like it has OTO issues even if its properly OTO'd.
    And for some reason, I used to be able to render the Magnet UST and now the program says it cant render properly.

    (also, you can change the resampler right????? i wasnt sure. i tried using moresampler but i dont think it worked.)
     
    mahalisyarifuddin likes this.
  9. susrever

    susrever Teto's Territory Defender of Defoko

    Messages
    27
    Likes Received
    82
    Trophy Points
    23
    I second the tempo bug, when I load an ust the tempo switches to 269 and I have to switch it back (also, for the next QoL could it be possible to change the slide to an "input your value" box? it feels tedious and it tends to be inaccurate the way it is now. Same also goes for the convel/preutt/overlap boxes) Also, when resetting the parameters of all the notes the program has a tendency to crash, specially if I try to change both the convel and reset preutterance/overlap. Overall, thought, I'm having far less crashes and a faster rendering but it still takes long to load usts and even the program itself is slow at loading. (This is more on Linux than on Windows. )
    Also, maybe its just me but it feels like that utsu is far more sensible with pitches than utau. I've tried the same ust on both utsu and utau and there's a feeling like the utsu render is squeakier. Like the modulation is not set to 0 but to something like 10, but maybe that's just an impression of mine.
    I've tested moresampler 0.8.4, fresamp 11 and 14, TIPS, tn_fsdn, the default resampler and vs4u and they all seem to work properly. Unfortunately, I couldn't get phavoco, bk_ and the EFB-GT like resamplers to work.
    Good luck for the 0.4 release !
     
    Wendi likes this.
  10. Wendi

    Wendi 熊熊 !!! Defender of Defoko

    Messages
    108
    Likes Received
    263
    Trophy Points
    68
    I have no experience with resamplers at all, so may i ask how you are changing the resampler? I downloaded moresampler and tried going to project properties and selecting moresampler.exe instead of macres but when i render theres no sound...
     
  11. susrever

    susrever Teto's Territory Defender of Defoko

    Messages
    27
    Likes Received
    82
    Trophy Points
    23
    for moresampler I believe I had changed both macres and the wavtool to moresampler to get it to work, for the others I simply changed the selected resamplers, left the wavtool field intact and rendered, so I don't know what to tell you.
    (I assume you are on windows, are you not? If you are not, then you can't change the resamplers.) Also, are you sure you have the correct version of moresampler? IIRC only 0.8.4 works, you can find a download for it if you scroll down in the utsu release page. Try some other resampler while leaving the wavtool part unchanged and see if it works, maybe.
     
    Wendi and Lethe like this.
  12. Wendi

    Wendi 熊熊 !!! Defender of Defoko

    Messages
    108
    Likes Received
    263
    Trophy Points
    68
    oh that explains a lot, I am not using windows. sigh thought UTSU would be a way for Mac users to use moresampler, thanks for explaining though.
     
    susrever likes this.
  13. 幸兔雪 (Yukito Yuki)

    幸兔雪 (Yukito Yuki) Defoko's Slaves Supporter Defender of Defoko

    Messages
    732
    Likes Received
    1,967
    Trophy Points
    123
    Hi!

    My suggestion is that UTSU would be able to convert
    • CV or VCV USTs to CVVC format
    • Romaji to Hiragana and vice versa
    • Converting ROMAJI encoded VCV USTs into Romaji CV. This is because Windows UTAU cannot do this properly at all
    Would be super sweet if Auto CVVC or Presamp’s abilities are implited into UTSU. Presamp is a cool UTAU plug-in that allows use CVVC VBs like CV! Also presamp can be made to support fully romaji VBs or even non-Japanese VBs like Korean and Chinese!

    The last suggestion:

    This doesn’t exit in UTAU nor a plug-in but it would be super helpful if UTSU had own “karaoke track” just like Vocaloid. In Vocaloid, you can have the off vocal and Vocaloid vocal in the same project. Hearing immediately how my tuning songs before mixing will speed up and help thing a lot.
     
    VocAddict and Kiyoteru like this.
  14. Mougeki Mero

    Mougeki Mero Defoko's Slaves Defender of Defoko

    Messages
    531
    Likes Received
    1,394
    Trophy Points
    122
    This is a lot of progress! Really good job so far, cant wait to test the new build!
     
  15. Wendi

    Wendi 熊熊 !!! Defender of Defoko

    Messages
    108
    Likes Received
    263
    Trophy Points
    68
    I've been using this program for the last couple of few days,
    I love how the default resampler sounds. Way less static than UTAU.
    There's a few issues though.
    I'm still having issues where note values are getting messed up and changed. This happens at least a few times in every UST i use. I havent been able to figure out any way i could fix this on my end. idk if its something im doing.
    I found a new bug where on some notes pitchbends just drop down from a note even if the next note is higher. This results in a really weird croaking noise or it sounds like the UTAU is not able to hit a note.
    Still having the tempo issue that i mentioned before.
    Also I have no idea if it's something I'm doing wrong but almost every UTAU I use sounds kinda like its preutterance or consonant velocity is messed up. VCV banks kinda sound like choppy CV banks. The transitions dont sound as smooth as UTAU's.
    Another quality-of-life feature you could add is (i dont know what its called) the automatic scrolling when it renders and plays. (idk if im being clear lol so i hope what im saying makes sense. like how in UTAU you see the bar move through the notes as it plays and the whole screen for you as it moves further into the ust)
     
  16. Lethe

    Lethe Ruko's Ruffians Supporter Defender of Defoko

    Messages
    32
    Likes Received
    184
    Trophy Points
    37
    I haven't found the tempo issue yet, but I did find out what was messing up the rhythms. It was a concurrency bug that was newly introduced in 0.3.1 and has now been fixed. I'll try the USTs you suggested and make sure the rhythms/tempo are correct before releasing again.

    Ironically, I first used a slider for these values because some users had complained about the input boxes in UTAU. I'll try to make UTSU support both sliders and input boxes for these values, but depending on how complicated it gets this may not be in the 0.4 release.

    I fixed some issues with crashing after resetting parameters. I have not yet fixed the slow load times for USTs and for the program itself, since that will require optimizing the program's threading and rushing into that without a plan will cause more issues than it fixes. (Exhibit A: the concurrency bug that messed up note rhythms in 0.3.1.)

    Is this the case for all resamplers, or only the default one? It may just be a side effect of macres.

    Thanks for testing! I would like UTSU to support all resamplers in the future, but this is de-prioritized for now since I mostly don't use Windows. If anyone wants to try debugging them, you can do so by running UTSU as a jar file from the command line and seeing what output the resampler spits out onto your terminal.

    Yeah, unfortunately there's no way to use moresampler on mac/linux right now apart from wrapping it in Wine. I do plan on writing some new cross-platform resamplers in the future once UTSU is more stable, but that's not going to happen for at least a few months.

    None of these features are planned in the upcoming 0.4 release, but a lot of them should be in the 0.5 release later on. I am planning on making a "reclist converter" that can translate between different reclists/encodings for the same language. Ideally it would include a way for users to import custom reclists using homemade configs so that the converter can work with those too. (Also note that UTSU can already read romaji lyrics as hiragana/katakana and vice versa. For example it can convert "mi" to something like "- みD4" automatically.)

    I'm planning to add karaoke tracks as well! Probably at the same time I add multiple tracks, so that both can use the same user interface.

    I think this is all caused by the concurrency issue mentioned above. But also there may be a bug in how UTSU handles consonant velocity in general.

    I have found an issue with macres where if a note has the moresampler Mt flag set, macres mistakes it as the "t" flag and starts pitching the note up and down. So that may be your issue. I'll fix macres for the next release to not mistake moresampler flags for normal flags.

    This will be in the 0.4 release!

    Progress report: I've been working pretty hard over the last few weeks on some new editor features. It's been a slog, but UTSU is almost ready for its 0.4 release! As usual I need another week of testing and bug-fixing, so the release is probably coming next weekend.
     
  17. susrever

    susrever Teto's Territory Defender of Defoko

    Messages
    27
    Likes Received
    82
    Trophy Points
    23
    can't wait! I've been using utsu on and off for the past week and yeah, for the slippery feel is mostly the default resampler, but also, fresamp (Not TIPS. Maybe it's something in macres. I'll have to test it with moresampler as the wavtool, but I do not have access to a Win laptop during the week and wine wrapping the resamplers on linux ended up in tears and crashed user sessions.) Also, I think that utsu suffers from the same problem Utau 0.4 + suffers on European Windows systems. Forgot to switch the decimal separator from comma to dot and Amaga Eru, who worked fine before, and she sounded slurried but fine when I changed back. Will have to test it again to confirm, though.
    Utsu so far is hasn't been crashing that much (mostly, it freezes for a while and then it works mostly fine again.)
    Good luck !
     
  18. Wendi

    Wendi 熊熊 !!! Defender of Defoko

    Messages
    108
    Likes Received
    263
    Trophy Points
    68
    yeet. I'm so excited even with the bugs I'm running into. I like this a loooooot.
     
  19. Lethe

    Lethe Ruko's Ruffians Supporter Defender of Defoko

    Messages
    32
    Likes Received
    184
    Trophy Points
    37
    Thanks for pointing this out! How do oto.ini files work when the decimal separator is a comma? Are individual oto entries not separated by commas in this case?

    The 0.4 update is now released! It's focused mostly on improving quality-of-life while making and editing USTs. As always you can go here to find new Windows/Mac installers and a new JAR executable.

    Change list is spoiler'd this time because there's so much stuff. :<
    • New editor features!
      • Modulation added to note properties editor.
      • Added menu items for cut/copy/paste/delete!
      • Can move all highlighted notes at once.
      • Can delete all highlighted notes at once.
      • Can cut/copy/paste all highlighted notes at once.
      • Added 1/64 quantization.
      • Can now undo/redo several song editor features:
        • Pasting, moving, resizing, deleting notes.
        • Changing lyrics, envelopes, portamento, vibrato.
        • Changing note properties. (But NOT song properties!)
      • Can now undo/redo several voicebank editor features:
        • Adding or removing aliases.
        • Changing oto.ini values.
        • Changing prefixmap entries.
    • UX changes.
      • Replaced ADD/EDIT/DELETE with a single mode that does everything:
        • LEFTCLICK: Does nothing, can be used to close unwanted context menus.
        • LEFTCLICK+DRAG: Creates new note.
        • RIGHTCLICK: Moves cursor to mouse location and opens context menu.
        • RIGHTCLICK+DRAG: Selects a group of notes.
        • SHIFT-CLICK: Moves cursor to mouse location.
        • SHIFT-CLICK+DRAG: Selects a group of notes.
        • RIGHTCLICK (on note): Opens note context menu.
        • SHIFT-CLICK (on note): Inclusively selects a note.
        • LEFTCLICK (on note): Exclusively selects a note.
        • LEFTCLICK+DRAG (on note): Resizes note or drags highlighted section.
      • Press ENTER to edit lyrics on highlighted note.
      • Press TAB to move to the next note while still editing lyrics.
      • Can use left and right arrow keys to move between notes while not editing lyrics.
      • During playback, window auto-scrolls so playback bar is always visible.
      • Note properties and exporting to WAV are now menu items.
      • Can now zoom in/out vertically as well as horizontally.
      • Song editor is more zoomed out by default.
      • Track now starts with a note of pre-roll.
      • Added hotkeys for all menu items!
    • New language: Brazilian Portuguese
      • Translations are a work in progress, not all messages will be translated!
    • Bug fixes.
      • Can now open voicebanks with oto.ini files that don't have aliases.
      • Scrollbar no longer jumps around when adding/deleting measures.
      • UI should no longer freeze when editing note properties.
      • UI should no longer freeze (as much) when changing voicebank in song properties.
      • Fixed concurrency bug that was causing timing errors in rendered output.
      • Defaults to 125.0 BPM when reading a UST with an unreasonably large tempo.
      • Default resampler now ignores moresampler-specific flags like Mt.
    Any user-requested feature that didn't make it into this update will be included in the 0.5 and 0.6 updates later on!

    Here's a picture of what Utsu looks like now:
    [​IMG]

    Future plans:
    Kind of burnt out after this update, so I may take a break from coding for a month or two. After that, the next planned features are:
    • Fixing inefficiencies and data leaks so Utsu is faster and doesn't eat up so much RAM.
    • User preferences editor, including color customization.
    • Built-in tools such as bulk editor, reclist converter.
    Utsu is also getting a marketing website pretty soon! @Soursop the fruit has been working on it for the past few months and it's just about ready for release.
     
  20. Pikachuk(SeleDreamsP)

    Pikachuk(SeleDreamsP) Teto is love, Teto is life (Rin too) Defender of Defoko

    Messages
    63
    Likes Received
    47
    Trophy Points
    22
    If you need some help to fix efficiency issues for stuff that isn't related to the main UI, I could program C++ optimized replacements that could be loaded from java if you want
     
    Prehnite and Kiyoteru like this.

Share This Page