2021.10
Collibra DIC Integration
Powered By GitBook
Transform

Transform Date

During DQ setup you can transform columns such as Dates and Numbers to preferred formats. It is a common need to replace N.A. with nulls or empty white space.

Example

1
./owlcheck \
2
-ds "dataset_transform" \
3
-rd "2018-01-31" \
4
-f "/Users/Documents/file.csv" \
5
-transform "purch_amt=cast(purch_amt as double)|return_amt=cast(return_amt as double)"
Copied!
Submit an expression to transform a string to a particular type
In this example, transform the purch_amt column to a double
1
-transform "purch_amt=cast(purch_amt as double)"
Copied!
Example of converting a string to a date
1
-transform "RECEIVED_DATE=to_date(CAST(RECEIVED_DATE AS STRING), 'yyyyMMdd') as RECEIVED_DATE"
Copied!
Last modified 20d ago
Copy link