Google Cloud Professional Data Engineer PDE — Topic 1 Question 296

Question

Your infrastructure team has set up an interconnect link between Google Cloud and the on-premises network. You are designing a high-throughput streaming pipeline to ingest data in streaming from an Apache Kafka cluster hosted on- premises. You want to store the data in BigQuery, with as minimal latency as possible. What should you do?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Use Dataflow, write a pipeline that reads the data from Kafka, and writes the data to BigQuery. BigQuery is a serverless, petabyte-scale data warehouse for fast SQL analytics with no infrastructure to manage. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling. This option meets the real-time / low-latency performance requirement.

Google Cloud Professional Data Engineer PDE — Question 296