Concept information
Preferred term
BERT
Definition
- « BERT est conçu pour pré-entraîner des représentations bidirectionnelles profondes à partir de textes non étiquetés en conditionnant conjointement les contextes gauche et droit dans toutes les couches. » (Devlin et al., 2019).
Broader concept
Bibliographic citation(s)
- • Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT : Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805 [cs]. http://arxiv.org/abs/1810.04805
base of
- ALBERT
- AlBERTo
- ALeaseBERT
- AlephBERT
- AraBERT
- ARBERT
- astroBERT
- BanglaBERT
- BEHRT
- BERTimbau
- BERTJapanese
- BERTje
- BERTopic
- BERT-PLI
- BERT-SentiX
- BERTurk
- BETO
- BioBERT
- BioMedBERT
- BlueBERT
- CharBERT
- ClinicalBERT
- convBERT
- COVID-Twitter-BERT
- Czech-B
- DeBERTa
- DistilBERT
- entityBERT
- estBERT
- FARM
- Finnish BERT
- FlauBERT
- German BERT
- GluonNLP
- golgotha
- GreekBERT
- HateBERT
- HeBERT
- HerBERT
- IndoBERT
- Kashgari
- KB-BERT
- KeyBERT
- KLUE-BERT
- KM-BERT
- KoBERT
- KR-BERT
- Legal-BERT
- MARBERT
- MathBERT
- M-BERT
- MC-BERT
- medBERT
- MobileBERT
- Mol-BERT
- MuRIL
- nanoBERT
- NetBERT
- OAG-BERT
- OpenNRE
- OuBioBERT
- ParsBERT
- PharmBERT
- PhoBERT
- ProkBERT
- ProteinBERT
- PubMedBERT
- RadBERT
- RBERT
- RoBERTa
- Romanian BERT
- ruBERT
- RxBERT
- SapBERT
- SBERT
- sciBERT
- Slavic BERT
- spanBERT
- Spark NLP
- Spark NLP Python
- Spark NLP Scala
- srBERT
- StructBERT
- TinyBERT
- TOD-BERT
- Tohoku-BERT
- Top2Vec
- UmlsBERT
- UTH-BERT
has application field
has design country
- États-Unis
has for input language
has repository
has download location
is implemented by
is encoded in
is executed in
has for license
In other languages
-
English
-
Bidirectional Encoder Representations from Transformers
URI
http://data.loterre.fr/ark:/67375/LTK-SSWGBD85-7
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}