cerebras.modelzoo.data_preparation.utils.split_list

cerebras.modelzoo.data_preparation.utils.split_list(l, n)

Splits list/string into n sized chunks.

Parameters

• l (List[str]) – List or string to split.

• n (int) – Number of chunks to split to.

Returns List[List]

List of lists containing split list/string.

previous

cerebras.modelzoo.data_preparation.utils.pad_instance_to_max_seq_length

next

cerebras.modelzoo.data_preparation.utils.text_to_tokenized_documents