Google Cloud Professional Data Engineer PDE — Topic 1 Question 88

Question

Your team is responsible for developing and maintaining ETLs in your company. One of your Dataflow jobs is failing because of some errors in the input data, and you need to improve reliability of the pipeline (incl. being able to reprocess all failing data). What should you do?

Accepted Answer

Correct answer: D. The correct answer is D. Option D: Add a try… catch block to your DoFn that transforms the data, use a sideOutput to create a PCollection that can be stored to Pub/Sub later. Pub/Sub is a serverless, global messaging service that decouples services and ingests high-volume event streams.

Google Cloud Professional Data Engineer PDE — Question 88