Google Cloud Professional Data Engineer PDE — Topic 1 Question 138

Question

You have several Spark jobs that run on a Cloud Dataproc cluster on a schedule. Some of the jobs run in sequence, and some of the jobs run concurrently. You need to automate this process. What should you do?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Create a Directed Acyclic Graph in Cloud Composer Cloud Composer is managed Apache Airflow for orchestrating multi-step data workflows.

Google Cloud Professional Data Engineer PDE — Question 138