Google Cloud Professional Data Engineer PDE — Topic 1 Question 297

Question

You migrated your on-premises Apache Hadoop Distributed File System (HDFS) data lake to Cloud Storage. The data scientist team needs to process the data by using Apache Spark and SQL. Security policies need to be enforced at the column level. You need a cost-effective solution that can scale into a data mesh. What should you do?

Accepted Answer

Correct answer: B. The correct answer is B. Option B: 1. Define a BigLake table.2. Create a taxonomy of policy tags in Data Catalog.3. Add policy tags to columns.4. Process with the Spark-BigQuery connector or BigQuery SQL. BigQuery is a serverless, petabyte-scale data warehouse for fast SQL analytics with no infrastructure to manage. Data Catalog provides metadata management and discovery across data assets. This option delivers the requirement at the lowest cost.

Google Cloud Professional Data Engineer PDE — Question 297