#bert
- 17 Nov 2025 · Study
Transformers · BERT
BERT as a bidirectional encoder pretrained with masked language modelling; running fill-mask, looking at [CLS] and [SEP], and seeing contextual embeddings change with meaning.
BERT as a bidirectional encoder pretrained with masked language modelling; running fill-mask, looking at [CLS] and [SEP], and seeing contextual embeddings change with meaning.