๐Ÿ”

DATA-ENGINEER-ASSOCIATE โ€” all questions

169 practice questions with answers and explanations.

Topic 1 ยท Question 1

A data organization leader is upset about the data analysis teamโ€™s reports being different from the data engineering teamโ€™s reports. The leader believes the siloed nature of their organizationโ€™s data engineering and data analysis architectures is to blame. Which of the following describes how a data lakehouse could alleviate this issue?

  • ABoth teams would autoscale their work as data size evolves
  • BBoth teams would use the same source of truth for their work (correct answer)
  • CBoth teams would reorganize to report to the same department
  • DBoth teams would be able to collaborate on projects in real-time
  • EBoth teams would respond more quickly to ad-hoc requests
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: Both teams would use the same source of truth for their work

Topic 1 ยท Question 2

Which of the following describes a scenario in which a data team will want to utilize cluster pools?

  • AAn automated report needs to be refreshed as quickly as possible. (correct answer)
  • BAn automated report needs to be made reproducible.
  • CAn automated report needs to be tested to identify errors.
  • DAn automated report needs to be version-controlled across multiple collaborators.
  • EAn automated report needs to be runnable by all stakeholders.
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: An automated report needs to be refreshed as quickly as possible.

Topic 1 ยท Question 3

Which of the following is hosted completely in the control plane of the classic Databricks architecture?

  • AWorker node
  • BJDBC data source
  • CDatabricks web application (correct answer)
  • DDatabricks Filesystem
  • EDriver node
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Databricks web application

Topic 1 ยท Question 4

Which of the following benefits of using the Databricks Lakehouse Platform is provided by Delta Lake?

  • AThe ability to manipulate the same data using a variety of languages
  • BThe ability to collaborate in real time on a single notebook
  • CThe ability to set up alerts for query failures
  • DThe ability to support batch and streaming workloads (correct answer)
  • EThe ability to distribute complex data operations
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: The ability to support batch and streaming workloads

Topic 1 ยท Question 5

Which of the following describes the storage organization of a Delta table?

  • ADelta tables are stored in a single file that contains data, history, metadata, and other attributes.
  • BDelta tables store their data in a single file and all metadata in a collection of files in a separate location.
  • CDelta tables are stored in a collection of files that contain data, history, metadata, and other attributes. (correct answer)
  • DDelta tables are stored in a collection of files that contain only the data stored within the table.
  • EDelta tables are stored in a single file that contains only the data stored within the table.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Delta tables are stored in a collection of files that contain data, history, metadata, and other attributes.

Topic 1 ยท Question 6

Which of the following code blocks will remove the rows where the value in column age is greater than 25 from the existing Delta table my_table and save the updated table?

  • ASELECT * FROM my_table WHERE age > 25;
  • BUPDATE my_table WHERE age > 25;
  • CDELETE FROM my_table WHERE age > 25; (correct answer)
  • DUPDATE my_table WHERE age <= 25;
  • EDELETE FROM my_table WHERE age <= 25;
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: DELETE FROM my_table WHERE age > 25;

Topic 1 ยท Question 7

A data engineer has realized that they made a mistake when making a daily update to a table. They need to use Delta time travel to restore the table to a version that is 3 days old. However, when the data engineer attempts to time travel to the older version, they are unable to restore the data because the data files have been deleted. Which of the following explains why the data files are no longer present?

  • AThe VACUUM command was run on the table (correct answer)
  • BThe TIME TRAVEL command was run on the table
  • CThe DELETE HISTORY command was run on the table
  • DThe OPTIMIZE command was nun on the table
  • EThe HISTORY command was run on the table
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: The VACUUM command was run on the table

Explanation

VACUUM removes old unreferenced Delta files after the retention period, reducing storage while preserving time-travel safety.

Topic 1 ยท Question 8

Which of the following Git operations must be performed outside of Databricks Repos?

  • ACommit
  • BPull
  • CPush
  • DClone
  • EMerge (correct answer)
Reveal answer & explanation
Correct answer: E

The correct answer is E. Option E: Merge

Topic 1 ยท Question 9

Which of the following data lakehouse features results in improved data quality over a traditional data lake?

  • AA data lakehouse provides storage solutions for structured and unstructured data.
  • BA data lakehouse supports ACID-compliant transactions. (correct answer)
  • CA data lakehouse allows the use of SQL queries to examine data.
  • DA data lakehouse stores data in open formats.
  • EA data lakehouse enables machine learning and artificial Intelligence workloads.
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: A data lakehouse supports ACID-compliant transactions.

Topic 1 ยท Question 10

A data engineer needs to determine whether to use the built-in Databricks Notebooks versioning or version their project using Databricks Repos. Which of the following is an advantage of using Databricks Repos over the Databricks Notebooks versioning?

  • ADatabricks Repos automatically saves development progress
  • BDatabricks Repos supports the use of multiple branches (correct answer)
  • CDatabricks Repos allows users to revert to previous versions of a notebook
  • DDatabricks Repos provides the ability to comment on specific changes
  • EDatabricks Repos is wholly housed within the Databricks Lakehouse Platform
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: Databricks Repos supports the use of multiple branches

Explanation

Databricks Repos integrates Git-based source control with workspace development workflows.

Topic 1 ยท Question 11

A data engineer has left the organization. The data team needs to transfer ownership of the data engineerโ€™s Delta tables to a new data engineer. The new data engineer is the lead engineer on the data team. Assuming the original data engineer no longer has access, which of the following individuals must be the one to transfer ownership of the Delta tables in Data Explorer?

  • ADatabricks account representative
  • BThis transfer is not possible
  • CWorkspace administrator (correct answer)
  • DNew lead data engineer
  • EOriginal data engineer
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Workspace administrator

Topic 1 ยท Question 12

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL. Which of the following commands could the data engineering team use to access sales in PySpark?

  • ASELECT * FROM sales
  • BThere is no way to share data between PySpark and SQL.
  • Cspark.sql("sales")D. spark.delta.table("sales") (correct answer)
  • Dspark.table("sales")
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: spark.sql("sales")D. spark.delta.table("sales")

Topic 1 ยท Question 13

Which of the following commands will return the location of database customer360?

  • ADESCRIBE LOCATION customer360;
  • BDROP DATABASE customer360;
  • CDESCRIBE DATABASE customer360; (correct answer)
  • DALTER DATABASE customer360 SET DBPROPERTIES ('location' = '/user'};
  • EUSE DATABASE customer360;
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: DESCRIBE DATABASE customer360;

Topic 1 ยท Question 14

A data engineer wants to create a new table containing the names of customers that live in France. They have written the following command: A senior data engineer mentions that it is organization policy to include a table property indicating that the new table includes personally identifiable information (PII). Which of the following lines of code fills in the above blank to successfully complete the task?

Exhibit 1 for question 14
  • AThere is no way to indicate whether a table contains PII.
  • B"COMMENT PII"
  • CTBLPROPERTIES PII
  • DCOMMENT "Contains PII" (correct answer)
  • EPII
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: COMMENT "Contains PII"

Topic 1 ยท Question 15

Which of the following benefits is provided by the array functions from Spark SQL?

  • AAn ability to work with data in a variety of types at once
  • BAn ability to work with data within certain partitions and windows
  • CAn ability to work with time-related data in specified intervals
  • DAn ability to work with complex, nested data ingested from JSON files (correct answer)
  • EAn ability to work with an array of tables for procedural automation
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: An ability to work with complex, nested data ingested from JSON files

Topic 1 ยท Question 16

Which of the following commands can be used to write data into a Delta table while avoiding the writing of duplicate records?

  • ADROP
  • BIGNORE
  • CMERGE (correct answer)
  • DAPPEND
  • EINSERT
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: MERGE

Topic 1 ยท Question 17

A data engineer needs to apply custom logic to string column city in table stores for a specific use case. In order to apply this custom logic at scale, the data engineer wants to create a SQL user-defined function (UDF). Which of the following code blocks creates this SQL UDF?

  • A (correct answer)
  • B
  • C
  • D
  • E
Reveal answer & explanation
Correct answer: A

The correct answer is A. This option scales automatically to match demand.

Topic 1 ยท Question 18

A data analyst has a series of queries in a SQL program. The data analyst wants this program to run every day. They only want the final query in the program to run on Sundays. They ask for help from the data engineering team to complete this task. Which of the following approaches could be used by the data engineering team to complete this task?

  • AThey could submit a feature request with Databricks to add this functionality.
  • BThey could wrap the queries using PySpark and use Pythonโ€™s control flow system to determine when to run the final query. (correct answer)
  • CThey could only run the entire program on Sundays.
  • DThey could automatically restrict access to the source table in the final query so that it is only accessible on Sundays.
  • EThey could redesign the data model to separate the data used in the final query into a new table.
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: They could wrap the queries using PySpark and use Pythonโ€™s control flow system to determine when to run the final query.

Topic 1 ยท Question 19

A data engineer runs a statement every day to copy the previous dayโ€™s sales into the table transactions. Each dayโ€™s sales are in their own file in the location "/transactions/raw". Today, the data engineer runs the following command to complete this task: After running the command today, the data engineer notices that the number of records in table transactions has not changed. Which of the following describes why the statement might not have copied any new records into the table?

Exhibit 1 for question 19
  • AThe format of the files to be copied were not included with the FORMAT_OPTIONS keyword.
  • BThe names of the files to be copied were not included with the FILES keyword.
  • CThe previous dayโ€™s file has already been copied into the table. (correct answer)
  • DThe PARQUET file format does not support COPY INTO.
  • EThe COPY INTO statement requires the table to be refreshed to view the copied rows.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: The previous dayโ€™s file has already been copied into the table.

Topic 1 ยท Question 20

A data engineer needs to create a table in Databricks using data from their organizationโ€™s existing SQLite database. They run the following command: Which of the following lines of code fills in the above blank to successfully complete the task?

Exhibit 1 for question 20
  • Aorg.apache.spark.sql.jdbc (correct answer)
  • Bautoloader
  • CDELTA
  • Dsqlite
  • Eorg.apache.spark.sql.sqlite
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: org.apache.spark.sql.jdbc

Showing questions 1โ€“20 of 169 ยท Page 1 of 9