Concept information
Preferred term
BERT
Definition
- "BERT is designed to pretrain deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers." (Devlin et al., 2019).
Broader concept
Entry terms
- Bidirectional Encoder Representations from Transformers
Bibliographic citation(s)
- • Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT : Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805 [cs]. http://arxiv.org/abs/1810.04805
base of
- ALBERT
- AlBERTo
- ALeaseBERT
- AlephBERT
- AraBERT
- ARBERT
- astroBERT
- BanglaBERT
- BEHRT
- BERTimbau
- BERTJapanese
- BERTje
- BERTopic
- BERT-PLI
- BERT-SentiX
- BERTurk
- BETO
- BioBERT
- BioMedBERT
- BlueBERT
- CharBERT
- ClinicalBERT
- convBERT
- COVID-Twitter-BERT
- Czech-B
- DeBERTa
- DistilBERT
- entityBERT
- estBERT
- FARM
- Finnish BERT
- FlauBERT
- German BERT
- GluonNLP
- golgotha
- GreekBERT
- HateBERT
- HeBERT
- HerBERT
- IndoBERT
- Kashgari
- KB-BERT
- KeyBERT
- KLUE-BERT
- KM-BERT
- KoBERT
- KR-BERT
- Legal-BERT
- MARBERT
- MathBERT
- M-BERT
- MC-BERT
- medBERT
- MobileBERT
- Mol-BERT
- MuRIL
- nanoBERT
- NetBERT
- OAG-BERT
- OpenNRE
- OuBioBERT
- ParsBERT
- PharmBERT
- PhoBERT
- ProkBERT
- ProteinBERT
- PubMedBERT
- RadBERT
- RBERT
- RoBERTa
- Romanian BERT
- ruBERT
- RxBERT
- SapBERT
- SBERT
- sciBERT
- Slavic BERT
- spanBERT
- Spark NLP
- Spark NLP Python
- Spark NLP Scala
- srBERT
- StructBERT
- TinyBERT
- TOD-BERT
- Tohoku-BERT
- Top2Vec
- UmlsBERT
- UTH-BERT
has application field
has design country
- United States
has for input language
has repository
has download location
is implemented by
is encoded in
is executed in
has for license
In other languages
-
French
URI
http://data.loterre.fr/ark:/67375/LTK-SSWGBD85-7
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}