Convert the bash scripts for splitting the info file and converting the chunks to parquet to python
Need to convert the shell scripts to python scripts with additional CLI interfaces since they are separate from the processing pipeline.
Need to convert the shell scripts to python scripts with additional CLI interfaces since they are separate from the processing pipeline.
changed milestone to %Distributable Package With Basic Functionality
assigned to @mdefende
Parquet conversion has been added with options for batch, parallel, and serial processing. #45 (closed) will be an enhancement to move the parallel processing to a separate function in the policy module and will be added later
This was previously completed
closed