Google Cloud Professional Data Engineer PDE — Topic 1 Question 110

Question

You are creating a new pipeline in Google Cloud to stream IoT data from Cloud Pub/Sub through Cloud Dataflow to BigQuery. While previewing the data, you notice that roughly 2% of the data appears to be corrupt. You need to modify the Cloud Dataflow pipeline to filter out this corrupt data. What should you do?

Accepted Answer

Correct answer: B. The correct answer is B. Option B: Add a ParDo transform in Cloud Dataflow to discard corrupt elements. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling.

Google Cloud Professional Data Engineer PDE — Question 110