modelzoo.transformers.pytorch.bert.bert_pretrain_models#

Classes

BertClassifierHead

BertMLMHead

BertMLMHeadTransform

BertPretrainModel

Bert Model with two heads on top as done during the pretraining: a masked language modeling head and a next sentence prediction (classification) head.

previous

modelzoo.transformers.pytorch.bert.bert_model.BertPooler

next

modelzoo.transformers.pytorch.bert.bert_pretrain_models.BertClassifierHead