Tokenizes files from the input path into output path.
Stanford CoreNLP is used for tokenization.
:param params: dict params: Tokenizer configuration parameters.
Tokenizes files from the input path into output path.
Stanford CoreNLP is used for tokenization.
:param params: dict params: Tokenizer configuration parameters.