Real-time-voice-cloning: google colab

Created on 30 Jun 2019 · 12Comments · Source: CorentinJ/Real-Time-Voice-Cloning

any plans to set this up in google colab as it provides free Nvidia t4 gpus for 12 hour cycles?

Source

ak9250

Most helpful comment

did somebody managed to get this working in Google Colab? Would really like to try but I don't have a gpu at home

I found this https://colab.research.google.com/github/ak9250/Real-Time-Voice-Cloning/blob/master/Real_Time_Voice_Cloning.ipynb

PapayasTehSkeletor on 15 Nov 2019

❤2

All 12 comments

Not from me, but I would certainly not mind linking it if someone makes one. I think a notebook-ish demo is doable

CorentinJ on 30 Jun 2019

@CorentinJ I see I have everything setup in colab but i think the problem is the demo_toolbox does not support non ui /running in cli yet?

I get this output running the demo_toolbox, demo_cli tests pass

WARNING: Logging before flag parsing goes to stderr.
W0701 03:24:00.135030 140347045406592 deprecation_wrapper.py:119] From /content/Real-Time-Voice-Cloning/synthesizer/models/modules.py:91: The name tf.nn.rnn_cell.RNNCell is deprecated. Please use tf.compat.v1.nn.rnn_cell.RNNCell instead.

Arguments:
datasets_root: /content/Real-Time-Voice-Cloning/UserAudio/speaker_01
enc_models_dir: encoder/saved_models
syn_models_dir: synthesizer/saved_models
voc_models_dir: vocoder/saved_models
low_mem: False

ak9250 on 1 Jul 2019

No, the CLI demo is not finished yet. You will have to wait until then.

CorentinJ on 1 Jul 2019

@CorentinJ any update on this, once it works I can send a PR if you would like to add the colab notebook to the repo

ak9250 on 28 Jul 2019

Yeah the CLI demo should be working, try it out.

CorentinJ on 28 Jul 2019

@CorentinJ just tried it got this error
/content/Real-Time-Voice-Cloning/UserAudio/speaker_01/audio_01.wav
Loaded file succesfully
Created the embedding
"this is a test"
Created the mel spectrogram
Synthesizing the waveform:
{| ████████████████ 57000/57600 | Batch Size: 6 | Gen Rate: 4.6kHz | }Caught exception: PortAudioError('Error querying device -1',)
Restarting

ak9250 on 28 Jul 2019

@ak9250 This is because in demo_cli.py, when synthesizing completes, the synthesized audio will be played. However the Colab VM doesn't have any audio device. You need to modify the code a bit.