Simpletransformers: QuestionAnsweringModel for Electra fine_tuning

[caprone]

HI
how I can load 'electra_base' pretrained into QuestionAnsweringModel for fine-tuning on custom json dataset?
seems that it' s only possible load 'generators or discriminatros' models...is that correct?
thanks

[ThilinaRajapakse]

ELECTRA models are always available as a generator-discriminator pair (list of pre-trained ELECTRA models).

When using them for any task other than language model training, you just use the discriminator. The generator is only used for LM training.

So, the model that you are looking for is google/electra-base-discriminator.

[caprone]

oh, thanks for great explanation!!

[ThilinaRajapakse]

Check out this article if you'd like to know more about ELECTRA!