modelzoo.transformers.pytorch.gpt2.sparse_mask

Functions

create_fixed_sparse_attention_mask

Create GPT-3 Fixed Sparse mask.

previous

modelzoo.transformers.pytorch.gpt2.scripts.fold_mup

next

modelzoo.transformers.pytorch.gpt2.sparse_mask.create_fixed_sparse_attention_mask