What's new

Synthesizer V Knowledge Resource

When I go to run script I get message input.txt not found. I’m on Mac (Ventura) and your details look like it’s for a pc system. I’ve tried putting the input.txt file in every place possible (all within /library/application support/dreamtonics/synthesizer v studio) with same results. Any suggestions what I may be missing?
I had to borrow a Mac to figure this one out. Try putting the file in your HOME folder and then pointing to it in the input box, e.g., "/Users/username/input.txt" - or if you put it in your Documents folder, "/Users/username/documents/input.txt" 2023-03-03 17_27_58-Window.png .

The downside on a Mac is this version won't save your config, so you'll need to do that each time. I'm working on an updated version of the script now, and I'll try to make it more Mac-friendly.
 
  • Like
Reactions: BDT
I had to borrow a Mac to figure this one out. Try putting the file in your HOME folder and then pointing to it in the input box, e.g., "/Users/username/input.txt" - or if you put it in your Documents folder, "/Users/username/documents/input.txt" 2023-03-03 17_27_58-Window.png .

The downside on a Mac is this version won't save your config, so you'll need to do that each time. I'm working on an updated version of the script now, and I'll try to make it more Mac-friendly.
Thanks for your suggested solution. It works! Thank you for creating the script. I guess I should learn how to write scripts myself they can be real timesavers.
 
Last edited:
The dictionary is made for cross language Japanese, yes, but it's made for Solaria, an English voicebank, so it was put into the "english-arpabet" folder because that's where native English voices look for dictionaries. If you create a "japanese-romaji" folder and put it there it'll show up for Japanese voicebanks as well, because that's the folder where native Japanese voices will look for dictionaries :)

Writing this out, I realize this might be something that can be improved in future versions of the program. Make it so it will also look in the folder of the currently selected language, instead of only the native language of the voicebank. This would only work for whole track cross language synthesis, of course, and not for note based one, but still.

@LenKiMo (I hope you don't mind tagging you), do you think this would be a good addition?
For the record, this worked and Mai has the dictionary. Being originally Japanese, she pronounces the “Spanish” phonemes much better than Solaria, who has a heavy English accent on many of them. However, I didn’t try much text yet, plus I am a newbie with Synth V. (Spanish is my main language, by the way…)
 
In my opinion, that Solaria's Spanish dictionary is not worth it as it's based on a (very limited) list of words. As in the Spanish language there is a very high phoneme-grapheme correspondence, I would bet on making a syllabic dictionary since it is very small (only 2316 possible syllables). The introduction of the lyrics in the editor would be in syllables instead of words, obviously.

However, not all syllables will sound good with Japanese phonemes and in some cases I would opt for English phonemes, having to change the language at the note level (which is currently possible).

One of the most problematic phoneme would be the Spanish J, but with a lot of Breathness and the growl script you can add a bit of grit to the /hh/ or /h/ phoneme.

I would like to try some of this but lately I have not found time for this hobby!.
I tend to agree, from my initial, newbie, tests with Solaria and Mai using the Solaria Spanish dictionary. A syllabic dictionary should work better.
 
Small update on Synth-V in Spanish.
In summary I don't know the reasons but... to get some results the recipe is this:
-Use Solaria or Kevin set to Japanese
-Put dictionary SOLARIA_JPN-_ESP in folder ...Documents\Dreamtonics\Synthesizer V Studio\dicts\english-arpabet (not a typo! putting it in japanese-romaji does not work!!!).
-Select THIS dictionary.

-Enter lyrics in plain Spanish, separated by (normal Spanish) syllables.
-Results have some "mild English accent", but not bad at all in most cases:
-Strong "RR" sound --> definitely not native!
-"J" --> Not native, not bad.
-"Z" --> Not from Spain, but latin accent ("seseo"), but other than this it works in 95% of the phonemes.

In a short test I used a random text:
"Lo siento, pero como modelo de lenguaje entrenado no tengo acceso a información en tiempo real sobre personas específicas"

Some phonemes have some accent (that can be corrected later up to a point), but they are ALL correct with the exception of "personas". The dictionary says it shoudl be pronounced as "p er s ax n ax z" but for some reason the last "z" is missing (!!), and Kevin sings "persona" in singlular. Why? No idea. But it is just 1 exception (see below)

1677275013201.png

And this is Kevin singing the stupid melody with the non-sense lyrics. Without ANY correction at all. I think it is a good starting point.

Veredict: It works... up to a point, I have no idea about the behaviour respect the location of the dictionary and I do not have high hopes to improve accent automatically because japanese does not contain the missing phonemes. I hope I can improve manually the missing / wrong phonemes.

I do not have high hopes to improve accent automatically because japanese does not contain the missing phonemes.
Aaah, let me see if I understand this. There will be a problem even if I managed to have Mai “see” the Spanish Dictionary: Solaria sings in Japanese using her English phonemes, and presumably uses them also for Spanish. But Mai has Japanese phonemes (which she also uses to sing in English). So the Solaria dictionary will ask her to use (English) phonemes she doesn’t have. Am I interpreting this correctly?
 
Thanks for your suggested solution. It works! Thank you for creating the script. I guess I should learn how to write scripts myself they can be real timesavers.
I've updated the version of the script in the original post. It should handle Macs okay now, as well as a couple more features.
 
Aaah, let me see if I understand this. There will be a problem even if I managed to have Mai “see” the Spanish Dictionary: Solaria sings in Japanese using her English phonemes, and presumably uses them also for Spanish. But Mai has Japanese phonemes (which she also uses to sing in English). So the Solaria dictionary will ask her to use (English) phonemes she doesn’t have. Am I interpreting this correctly?
Not quite, the dictionary is originally made for Solaria, a native English library, but it's only useable if you set the voicebank to sing in Japanese via the cross-language feature. The Japanese cross language feature will use Japanese phonemes (albeit accented if you use a non-native Japanese voicebank), so if you put the dictionary in the japanese-romaji folder it will work for native Japanese voices like Mai, and it should theoretically have a more Japanese accent since Mai is a native Japanese voicebank.
It will never be 100% perfect because Japanese and Spanish, while more similar than English and Spanish, still don't share all of the proper phonemes, so it will be quite accented.

My personal favourite way to achieve languages not supported by SynthV, like French, Spanish or Italian, is by doing everything by hand and mixing all 3 supported languages (English, Japanese and Mandarin) note by note, by trying phoneme combinations until I get a decent enough sound, so I tend not to use dictionaries. And with the upcoming Cantonese support there should be even more possible vowels to choose from in the future.
It is a really tedious job though and it requires a lot of trial and error.
 
Aaah, let me see if I understand this. There will be a problem even if I managed to have Mai “see” the Spanish Dictionary: Solaria sings in Japanese using her English phonemes, and presumably uses them also for Spanish. But Mai has Japanese phonemes (which she also uses to sing in English). So the Solaria dictionary will ask her to use (English) phonemes she doesn’t have. Am I interpreting this correctly?
For some reason I cannot use Solaria dictionary with Mai (it does not matter where I put it), so this logical and sensible approach does not work for some (non logical or sensible) reason.

On the other hand you mentioned in your post "For the record, this worked and Mai has the dictionary..." Which one? How did you get Mai to sing accented Spanish? I tried and could not do it. You know, in my opinion this SHOULD HAVE worked... but did not for me.
 
For some reason I cannot use Solaria dictionary with Mai (it does not matter where I put it), so this logical and sensible approach does not work for some (non logical or sensible) reason.

On the other hand you mentioned in your post "For the record, this worked and Mai has the dictionary..." Which one? How did you get Mai to sing accented Spanish? I tried and could not do it. You know, in my opinion this SHOULD HAVE worked... but did not for me.
That's weird, if you put the dictionary into the japanese-romaji folder it should show up for all native Japanese voicebanks. What does your folder setup look like? It should look like this:

Cattura.PNG

Anything inside the english-arpabet folder will only be seen by native English voices. Native Japanese voices like Mai will look into the japanese-romaji folder, while native Mandarin voices will look into mandarin-xsampa.
If you want any voice to be able to use the Spanish dictionary Eclipsed Sounds made for Solaria, you should have a copy of SOLARIA_JPN-_ESP.json in each folder.
 
That's weird, if you put the dictionary into the japanese-romaji folder it should show up for ....
I've just tried. What you say makes sense, but reality (at least in my installation) is a bit different. And as I said, real behaviour makes no sense:

The Solaria Dictionary (JPN --> SPA) works in all languages for Kevin and Solaria. You set Solaria to sing in Mandarin, then you can access the dictionary. BUT ONLY IF IT IS INSTALLED in english-arpabet! You have just 1 copy there, it works in the 3 languages. You put it only in japanese-romaji, it simply stops working. In all languages.

BUT you are correct that Mai can access Solaria JPN-->SPA dictionary. And also from all languages! But if and only if the dictionary is located (this time) in japanese-romaji folder.

You replicated the dictionary in the 3 folders assuming some "logical" behaviour and it worked. But the behaviour is really strange. You can see if you remove the dictionary from Mandarin folder, you can use it with Solaria or Kevin or Mai. And also in Mandarin!

Apparently the fact that the dictionary is called "JPN-_ESP" has nothing to do with Japanese. It is just Spanish phonetics for the voice, works the same regardless of you choosing JAP, ESP or ENG and it requires that this dictionary is located in the folder corresponding to the original phonetics of the voice.

Anyway logical or not MAI NOW WORKS FOR ME! Thanks!

I Totally agree on the limitations depending on original phonetics and the need to manually tweak, but this dictionary is a good help. Beware, each copy makes loading time longer.
 
Oh yeah, it's because as I said those folders are what's used by native language voicebanks. If you set Solaria to sing in Japanese or Mandarin, Solaria's native language is still English, because it's an English voicebank, so it will only look in the english-arpabet folder for its dictionaries, even if they're specifically made to work with the Japanese cross-language feature.
Likewise Mai is a native Japanese voicebank, so it will only look into the japanese-romaji folder for dictionaries. So if you have an English dictionary you want to use with Mai set to cross-language English, you will still need to put it into japanese-romaji because Mai's native language is Japanese :)

And yeah, the more dictionaries you have, the longer it will take for the program to load, unfortunately.
 
I've updated the version of the script in the original post. It should handle Macs okay now, as well as a couple more features.

Hi @Finney. Thanks for sharing your script. It works exactly as you described on my Ventura Mac. I think this is a great script for someone like me just starting to learn Synth V.

I have a general query for the Synth V experts:
I’m wondering if it would be possible to reverse Finney’s workflow a little. I like to start with the notes alone in one track and sync it with an instrument backing track. Is there a way (with a different script or just using Synth V) to bulk load lyrics from a txt file so that the default “la la la’s” are replaced with the lyrics? The pitch, duration and automation of notes in the piano roll should remain untouched. If there are more notes than lyric syllables, the overwriting ends. Or if there or more syllables than notes, it adds new C4 notes until the text input is complete.
Thanks.
 
Hi @Finney. Thanks for sharing your script. It works exactly as you described on my Ventura Mac. I think this is a great script for someone like me just starting to learn Synth V.

I have a general query for the Synth V experts:
I’m wondering if it would be possible to reverse Finney’s workflow a little. I like to start with the notes alone in one track and sync it with an instrument backing track. Is there a way (with a different script or just using Synth V) to bulk load lyrics from a txt file so that the default “la la la’s” are replaced with the lyrics? The pitch, duration and automation of notes in the piano roll should remain untouched. If there are more notes than lyric syllables, the overwriting ends. Or if there or more syllables than notes, it adds new C4 notes until the text input is complete.
Thanks.
Hi Adagio-if I understand your question correctly, you can already do that. Copy your lyrics to the clipboard, right click on any note and "insert lyrics" (I think that's it; don't have the app available right now). It will spread them out over the ensuing notes, breaking them on spaces. If you add - or + between the pasted lyrics, it will span notes with a single syllable, or will break break the words on syllables respectively
.
 
Hi Adagio-if I understand your question correctly, you can already do that. Copy your lyrics to the clipboard, right click on any note and "insert lyrics" (I think that's it; don't have the app available right now). It will spread them out over the ensuing notes, breaking them on spaces. If you add - or + between the pasted lyrics, it will span notes with a single syllable, or will break break the words on syllables respectively
.
Thank you!
 
I feel that this thread gets neglected, so here's something to bring it back. Not sure if you all have seen this video, but it does contain some great tips about making Synth-V sound more human. The tips regarding idiomatic syllable emphasis, I think are particularly relevant, and its an issue I see a lot from Synth-V users who come from a background of writing for instruments rather than voice, and, I suspect from users who use SV in English, but that is not their native language. People put a lot of work into tuning SV voices, but often neglect natural syllable emphasis in words.

 
Top Bottom