Concept information
Preferred term
StructBERT
Definition
- "a new type of contextual representation, StructBERT, which incorporates language structures into BERT pre-training by proposing two novel linearization strategies. Specifically, in addition to the existing masking strategy, StructBERT extends BERT by leveraging the structural information: word-level ordering and sentence-level ordering." (Wang et al., 2019).
Broader concept
Bibliographic citation(s)
- • Wang, W., Bi, B., Yan, M., Wu, C., Bao, Z., Xia, J., Peng, L., & Si, L. (2019). StrutcBERT: incorporating language structures into pre-training for deep language understanding. https://arxiv.org/abs/1908.04577v3
based on
has application field
has design country
- China
has for input language
has repository
has download location
implements
is encoded in
is executed in
has for license
In other languages
-
French
URI
http://data.loterre.fr/ark:/67375/LTK-N4MFP3CQ-3
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}