Google Cloud Professional Data Engineer PDE — Topic 1 Question 237

Question

You are planning to load some of your existing on-premises data into BigQuery on Google Cloud. You want to either stream or batch-load data, depending on your use case. Additionally, you want to mask some sensitive data before loading into BigQuery. You need to do this in a programmatic way while keeping costs to a minimum. What should you do?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Create your pipeline with Dataflow through the Apache Beam SDK for Python, customizing separate options within your code for streaming, batch processing, and Cloud DLP. Select BigQuery as your data sink. Google Cloud Batch schedules and runs batch jobs at scale without managing infrastructure. BigQuery is a serverless, petabyte-scale data warehouse for fast SQL analytics with no infrastructure to manage. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling.

Google Cloud Professional Data Engineer PDE — Question 237