Google Cloud Professional Data Engineer PDE — Topic 1 Question 153

Question

You operate an IoT pipeline built around Apache Kafka that normally receives around 5000 messages per second. You want to use Google Cloud Platform to create an alert as soon as the moving average over 1 hour drops below 4000 messages per second. What should you do?

Accepted Answer

Correct answer: A. The correct answer is A. Option A: Consume the stream of data in Dataflow using Kafka IO. Set a sliding time window of 1 hour every 5 minutes. Compute the average when the window closes, and send an alert if the average is less than 4000 messages. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling.

Google Cloud Professional Data Engineer PDE — Question 153