cerebras.modelzoo.data_preparation.vision.unet.create_hdf5_files#

Script to write HDF5 files for UNet datasets.

Usage:

# For help: python create_hdf5_files.py -h

# Step-1: Set image shape to desired shape in train_input.image_shape and eval_input.image_shape i.e. [H, W, 1] in config: /path_to_modelzoo/vision/pytorch/unet/configs/params_severstal_binary.yaml

# Step-2: Run the script python modelzoo.data_preparation.vision.unet.create_hdf5_files.py –params=/path_to_modelzoo/vision/pytorch/unet/configs/params_severstal_binary.yaml –output_dir=/path_to_outdir/severstal_binary_classid_3_hdf –num_output_files=10 –num_processes=5

Functions

create_h5

create_h5_mp

get_parser_args

main

update_params_from_args

Sets command line arguments from args into params.