πŸ”

DATA-ENGINEER-ASSOCIATE β€” questions

Page 9 of 9 Β· 169 total questions.

Topic 1 Β· Question 161

A data engineer and data analyst are working together on a data pipeline. The data engineer is working on the raw, bronze, and silver layers of the pipeline using Python, and the data analyst is working on the gold layer of the pipeline using SQL. The raw source of the pipeline is a streaming input. They now want to migrate their pipeline to use Delta Live Tables. Which of the following changes will need to be made to the pipeline when migrating to Delta Live Tables?

  • AThe pipeline will need to be written entirely in Python (correct answer)
  • BThe pipeline will need to stop using the medallion-based multi-hop architecture
  • CThe pipeline will need to be written entirely in SQL
  • DThe pipeline will need to use a batch source in place of a streaming source
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: The pipeline will need to be written entirely in Python This option meets the real-time / low-latency performance requirement.

Topic 1 Β· Question 162

A data engineer needs access to a table new_table, but they do not have the correct permissions. They can ask the table owner for permission, but they do not know who the table owner is. Which of the following approaches can be used to identify the owner of new_table?

  • AReview the Permissions tab in the table's page in Data Explorer
  • BThere is no way to identify the owner of the table
  • CReview the Owner field in the table's page in Data Explorer (correct answer)
  • DReview the Owner field in the table's page in the cloud storage solution
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Review the Owner field in the table's page in Data Explorer

Topic 1 Β· Question 163

In which of the following scenarios should a data engineer use the MERGE INTO command instead of the INSERT INTO command?

  • AWhen the location of the data needs to be changed
  • BWhen the target table is an external table
  • CWhen the source is not a Delta table
  • DWhen the target table cannot contain duplicate records (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: When the target table cannot contain duplicate records

Topic 1 Β· Question 164

A data engineer is designing a data pipeline. The source system generates files in a shared directory that is also used by other processes. As a result, the files should be kept as is and will accumulate in the directory. The data engineer needs to identify which files are new since the previous run in the pipeline, and set up the pipeline to only ingest those new files with each run. Which of the following tools can the data engineer use to solve this problem?

  • AUnity Catalog
  • BDelta Lake
  • CDatabricks SQL
  • DAuto Loader (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: Auto Loader

Explanation

Auto Loader incrementally and efficiently ingests new cloud files using checkpointed discovery and exactly-once processing with Delta Lake.

Topic 1 Β· Question 165

What is stored in the Databricks customer's cloud account?

  • ADatabricks web application
  • BCluster management metadata
  • CNotebooks
  • DData (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: Data

Topic 1 Β· Question 166

A data engineer wants to create a relational object by pulling data from two tables. The relational object does not need to be used by other data engineers in other sessions. In order to save on storage costs, the data engineer wants to avoid copying and storing physical data. Which of the following relational objects should the data engineer create?

  • ASpark SQL Table
  • BView
  • CDelta Table
  • DTemporary view (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: Temporary view

Topic 1 Β· Question 167

Which of the following commands will return the number of null values in the member_id column?

  • ASELECT count(member_id) FROM my_table;
  • BSELECT count(member_id) - count_null(member_id) FROM my_table;
  • CSELECT count_if(member_id IS NULL) FROM my_table; (correct answer)
  • DSELECT null(member_id) FROM my_table;
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: SELECT count_if(member_id IS NULL) FROM my_table;

Topic 1 Β· Question 168

Which tool is used by Auto Loader to process data incrementally?

  • ACheckpointing
  • BSpark Structured Streaming (correct answer)
  • CDatabricks SQL
  • DUnity Catalog
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: Spark Structured Streaming

Explanation

Structured Streaming provides fault-tolerant incremental processing with checkpointing using the Spark DataFrame API.

Topic 1 Β· Question 169

A data engineer is working with two tables. Each of these tables is displayed below in its entirety. The data engineer runs the following query to join these tables together: Which of the following will be returned by the above query?

Exhibit 1 for question 169Exhibit 2 for question 169
  • A
  • B
  • C (correct answer)
  • D
Reveal answer & explanation
Correct answer: C

The correct answer is C.

Showing questions 161–169 of 169 Β· Page 9 of 9