What's new

Synthesizer V Studio 1.11.0b1 Update: Voice to MIDI and ARA2 Integration

David Cuny

Grand Poobah, Royal Order of WordBuilders
Features:
  1. Voice to MIDI
  2. Deep ARA2 integration

Find it at: https://resource.dreamtonics.com/download/English/Synthesizer V Studio Beta Version/1.11.0b1/

Updates for voices at: https://resource.dreamtonics.com/download/English/Voice Databases/Beta Releases/

In case it's not obvious from the screenshot on the page, to use Voice to MIDI:
  1. Load the audio as a backing track by choosing Project | Create a New Instrumental Track
  2. Select the track by clicking on the audio track waveform.
  3. Choose Audio Process | Extract Notes From Audio from the menu.
  4. Fix the phonemes.
  5. Fix the pitches - it will occasionally get them wrong.
 
Last edited:
If you're wondering how the well the Audio to MIDI works, here's everyone's favorite song from Charlie and the Chocolate Factory:

Cheer Up Charlie - Eleanor Forte replacing Diana Lee's vocals:
View attachment Cheer Up Charlie.mp3

There are a lot of places where SynthV gets the lyrics wrong, so that requires cleanup. There were also a few wrong notes which needed to be fixed.

I've cleaned up some of the obvious problems, but left some of the cringe-inducing warbles as-is. :confused:

The Scale Pitch Deviation script is especially useful in cleaning things up quickly.

Edit: I went ahead and cleaned up most the remaining issues - more wrong words, pitches, and warbles - I figured I'd post the final version:

Cheer Up Charlie (Final cleanup):
View attachment Cheer Up Charlie - Corrected.mp3
 
Last edited:
Top Bottom