Retention based purge of data can be turned on to allow data to automatically be cleaned based on an organization's data retention policy.
In order to set up retention based data purge, three (3) environment variables need to be set up in the owl-env.sh configuration script. Note: a restart of the webapp is required for this configuration to take place.
TRUE or FALSE on whether this feature is enabled
Number of days to retain data
Controls which field to use to select eligible dataset runs
updt_ts: consider the last time a dataset run was updated
run_id: consider the run id field of the dataset
Example configuration in owl-env.sh
Organization wants to purge data where the updt_ts is more than 1 year old
In owl-env.sh, add the following lines
export cleaner_retention_enabled=TRUEexport cleaner_retention_days=365export cleaner_retention_field="updt_ts"