cerebras.modelzoo.data_preparation.nlp.pile.download.debug_or_download_individual_file#

cerebras.modelzoo.data_preparation.nlp.pile.download.debug_or_download_individual_file(url, filepath, debug=False)[source]#

Download a single file from url to specified filepath.

Parameters

  • url (str) – Url to download the data from.

  • filepath (str) – Filename (with path) to download the data to.

  • debug (bool) – Check if remote file exists. Defaults to False.

previous

cerebras.modelzoo.data_preparation.nlp.pile.download

next

cerebras.modelzoo.data_preparation.nlp.pile.download.download_pile