diverse_beam_strength is a tuple, but does not currently support tuples.
Are you expanding diverse beam search? Or is it wrong to be a tuple?
I removed the brackets and the comma, and it seemed to work.
diverse_beam_strength = (getattr(args, "diverse_beam_strength", 0.5),)
==>
diverse_beam_strength = getattr(args, "diverse_beam_strength", 0.5)
Yes, this was a bug introduced in fab2e86e51f48301146a37fc86d01fdbf5e8a5f2. @Nickeilf's fix is correct, I'll submit a PR for it shortly.
Most helpful comment
I removed the brackets and the comma, and it seemed to work.
diverse_beam_strength = (getattr(args, "diverse_beam_strength", 0.5),)==>
diverse_beam_strength = getattr(args, "diverse_beam_strength", 0.5)