modelzoo.transformers.pytorch.layers_api_demo.pytorch_transformer.generate_square_subsequent_mask

modelzoo.transformers.pytorch.layers_api_demo.pytorch_transformer.generate_square_subsequent_mask(sz: int, device=None) → torch.Tensor

Generates an upper-triangular matrix of -inf, with zeros on diag.

previous

modelzoo.transformers.pytorch.layers_api_demo.pytorch_transformer

next

modelzoo.transformers.pytorch.layers_api_demo.pytorch_transformer.PositionalEncoding