Tensor2tensor: NMT for dummies

[dinosaxon]

Is there any NMT tutorial for dummies?

I would like to know if there is a step-by-step tutorial on how an NMT engine is trained and what each parameter means.

Thank you for your help!

[martinpopel]

A step-by-step guide is the "Walkthrough".
Tensor2tensor is a research project with SotA results and frequent changes in the source code, not a tutorial framework for dummies. Thus the best explanation of most parameters is in the source code (the documentation may be outdated and incomplete).
There are many other NMT frameworks which are more suitable (I think) for tutorials, e.g. OpenNMT and Neural Monkey (see its NMT tutorial) - but these don't achieve the SotA results (yet).

[dinosaxon]

Thank you for your reply. I can understand that it's difficult to maintain a tutorial, but I was wondering if any users created something from their experience so far.

[martinpopel]

Oh yes, my experience is summarized in this paper.

[dinosaxon]

That's great! This is what I was looking for.

[vince62s]

@martinpopel FYI I replicated T2T EN-DE with both OpentNMT-TF AND OpenNMT-py
the TF one is already there for download.
the Pytorch one will be shortly.

[stefan-it]

@dinosaxon Another great nmt tutorial is the TensorFlow nmt project :) There are many useful explanations which really helps to understand sequence-to-sequence models.

[dinosaxon]

@stefan-it Thank you, Stefan! This is also great :)