Concept information
Preferred term
ELECTRA
Definition
- Pre-trained language model by replacing some tokens with plausible alternatives sampled from a small generator network. (Clark et al., 2020)
Broader concept
Entry terms
- Efficiently Learning an Encoder that Classifies Token Replacements Accurately
In other languages
-
French
URI
http://data.loterre.fr/ark:/67375/8LP-WR2RGPQQ-7
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}