This encompasses many changes to the submit-pol-job and run-mmpol.sh that were originally pushed to rel_v0.1.1-1 but that branch got messed up. Reverting was going to be more work than creating a new release version. The level of changes in this merge have the qualities of a new minor release in any case so is warranted. All of the changes over three prior merge requests are listed below.
Major changes:
getopt functionality allowing the user to specify the following variables in the function call:
outdir: parent directory for the log to be placed inoutput-log-prefix: the prefix to add to the policy file name to specify extra metadatapolicy-file: path to the policy filedevice: path or name of the target of the policyrun-mmpol.sh script. These were also removed from the submit-pol-job script and replaced with the corresponding values to be explicitly passeddevice path or name if not passed as an argumentrws for the containing directory and r-- for the log itselfgzip the log filerun-mmpol now creates a single directory to store the raw policy output, the split gz files, and the parquet files plus anything else associated with the run. The directory name matches the name of the log file.Minor changes:
/ to -. All metadata entries in the file/directory names are separated by _ for clarityrun-mmpol.sh. Now the device must be specified regardless of which script is run.Syntax Changes:
"{}" for clarity in variable substitution.$() when performing command substitutionIssues Fixed: