Google Cloud Professional Data Engineer PDE — Topic 1 Question 256

Question

You are deploying an Apache Airflow directed acyclic graph (DAG) in a Cloud Composer 2 instance. You have incoming files in a Cloud Storage bucket that the DAG processes, one file at a time. The Cloud Composer instance is deployed in a subnetwork with no Internet access. Instead of running the DAG based on a schedule, you want to run the DAG in a reactive way every time a new file is received. What should you do?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: 1. Enable the Airflow REST API, and set up Cloud Storage notifications to trigger a Cloud Function instance.2. Create a Private Service Connect (PSC) endpoint.3. Write a Cloud Function that connects to the Cloud Compo... Cloud Storage provides durable, scalable object storage that is fully managed. Private Service Connect exposes and consumes services privately within VPCs without internet exposure. Cloud Composer is managed Apache Airflow for orchestrating multi-step data workflows.

Google Cloud Professional Data Engineer PDE — Question 256