Google Cloud Professional Data Engineer PDE — Topic 1 Question 156

Question

You are planning to migrate your current on-premises Apache Hadoop deployment to the cloud. You need to ensure that the deployment is as fault-tolerant and cost-effective as possible for long-running batch jobs. You want to use a managed service. What should you do?

Accepted Answer

Correct answer: A. The correct answer is A. Option A: Deploy a Dataproc cluster. Use a standard persistent disk and 50% preemptible workers. Store data in Cloud Storage, and change references in scripts from hdfs:// to gs:// Preemptible/Spot VMs use spare capacity at a large discount for fault-tolerant, interruptible work. Cloud Storage provides durable, scalable object storage that is fully managed. Persistent Disk provides durable block storage attached to Compute Engine VMs. This option delivers the requirement at the lowest cost.

Google Cloud Professional Data Engineer PDE — Question 156