Skip to main

ThesoTM thesaurus

Search from vocabulary

Concept information

Término preferido

TinyBERT  

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Definición

  • "TinyBERT is 7.5x smaller and 9.4x faster on inference than BERT-base and achieves competitive performances in the tasks of natural language understanding. It performs a novel transformer distillation at both the pre-training and task-specific learning stages." (source: https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TinyBERT).

Concepto genérico

En otras lenguas

URI

http://data.loterre.fr/ark:/67375/LTK-LKG67B9D-D

Descargue este concepto: