Hi team,
We are currently using AVRO, XML, and plain binary formats for the data landed in data lake in the raw zone. We are transforming all data stored in the curated zone as Parquet format. However, there are compliance requirements to also delete customer data in the raw zone. It would be awesome if this solution can be further enhanced to support additional formats.
Hi team,
We are currently using AVRO, XML, and plain binary formats for the data landed in data lake in the raw zone. We are transforming all data stored in the curated zone as Parquet format. However, there are compliance requirements to also delete customer data in the raw zone. It would be awesome if this solution can be further enhanced to support additional formats.