cerebras.modelzoo.common.utils.model.transformer_utils.smooth_loss

cerebras.modelzoo.common.utils.model.transformer_utils.smooth_loss(prediction_scores, loss, label_smoothing, classes)

Add label smoothing to loss function, this is a workaround method of label smoothing in our system

previous

cerebras.modelzoo.common.utils.model.transformer_utils.make_sparse_mask_broadcastable

next

cerebras.modelzoo.common.utils.model.vocab_utils