AWS Certified Data Engineer - Associate DEA-C01 — Topic 1 Question 35

Question

A company uses Amazon S3 to store semi-structured data in a transactional data lake. Some of the data files are small, but other data files are tens of terabytes. A data engineer must perform a change data capture (CDC) operation to identify changed data from the data source. The data source sends a full snapshot as a JSON file every day and ingests the changed data into the data lake. Which solution will capture the changed data MOST cost-effectively?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Use an open source data lake format to merge the data source with the S3 data lake to insert the new data and update the existing data. Amazon S3 provides durable, scalable object storage that is fully managed. This option delivers the requirement at the lowest cost.

AWS Certified Data Engineer - Associate DEA-C01 — Question 35