modelzoo.transformers.pytorch.t5.input.utils.parse_text#

modelzoo.transformers.pytorch.t5.input.utils.parse_text(text, do_lower)[source]#

Postprocessing of the CSV file. :param: str text: String with an input text.

Returns

List of parsed tokens.

previous

modelzoo.transformers.pytorch.t5.input.utils.pad_t5_input_features

next

modelzoo.transformers.pytorch.t5.input.utils.random_spans_noise_mask