AWS Certified Data Engineer - Associate DEA-C01 — Topic 1 Question 310

Question

A data engineer needs to validate the quality of files that are uploaded to an Amazon S3 bucket every day. The files are in CSV and JSON formats and schema variations exist. The data engineer needs a repeatable process to monitor data quality metrics such as null values, format inconsistencies, and outliers. The process must provide reusable rule-based profiling and scale across multiple datasets with minimal manual effort or custom code. Which solution will meet these requirements?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Use AWS Glue DataBrew to configure profiling jobs and reusable recipe actions. Schedule the profiling jobs and reusable recipe actions to run against each dataset in Amazon S3. Amazon S3 provides durable, scalable object storage that is fully managed. AWS Glue is a serverless ETL and data-catalog service that prepares and integrates data. AWS Config tracks resource configuration changes and evaluates compliance.

AWS Certified Data Engineer - Associate DEA-C01 — Question 310