Tts: [WIP] tf 2.0 implementation of tts

Created on 10 Oct 2019  路  13Comments  路  Source: mozilla/TTS

With the arrival of tf 2.0, I like to give it a try. Probably it would be a separate repo but might be useful for deployment. I'd guess it'd be ready in a week.

help wanted

Most helpful comment

I don't think I have enough resources right now to work on this. If anyone is volunteering, you are more then welcome to give it a go. I am also ready to help.

All 13 comments

@erogol How's the work going bro.

This is pretty much stuck with TF 2.0 deficiencies especially with changing sequence length causing constant retracing.

Hello @erogol, what about https://www.tensorflow.org/guide/ragged_tensor? Were introduced to deal with dimension changing tensor, unfortunately as far as I know there's no benchmark

I don't think I have enough resources right now to work on this. If anyone is volunteering, you are more then welcome to give it a go. I am also ready to help.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discourse page for further help. https://discourse.mozilla.org/c/tts

hi @erogol, with tf.text and its preprocessing layers returning RaggedTensor, it's much easier to work with inputs of different lengths. Now that I'm working on a neural TTS project in Turkish (novel dataset, sound annotating utility and training code), I'm volunteer to give it a try. What should I do next? Forking the repo, or any other model for collaboration?

You can fork it and give it a go. Then we can iterate together. That would be great .

Great, let you know when I make a progress.

In case anyone is interested. I reiterate TTS with Tensorflow eager mode.

@monatis any updates on your side.

Hello @erogol, what about https://www.tensorflow.org/guide/ragged_tensor? Were introduced to deal with dimension changing tensor, unfortunately as far as I know there's no benchmark

Ragged Tensor looks promising but I am still struggling to convert TTS to TTS_tf due to other TF specific problems.
Such as, in eager mode tf.function tracing, I could not figure out the way to dynamically generate new tensors depending on the input shape here since input tensor has a partial shape at tracing.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discourse page for further help. https://discourse.mozilla.org/c/tts

I reopen and close this as I added TF 2.0 Tacotron2 implementation.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

faaip picture faaip  路  5Comments

xoxoxo13102020 picture xoxoxo13102020  路  9Comments

erogol picture erogol  路  11Comments

vcjob picture vcjob  路  7Comments

PetrochukM picture PetrochukM  路  9Comments