cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.RequestType

class cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.RequestType

Bases: enum.IntEnum

An enumeration.

Attributes

loglikelihood
generate_until

previous

cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.InferenceDataProcessorLL

next

cerebras.modelzoo.data.nlp.t5