πŸ”

DATA-ENGINEER-ASSOCIATE β€” questions

Page 8 of 9 Β· 169 total questions.

Topic 1 Β· Question 141

Identify a scenario to use an external table. A Data Engineer needs to create a parquet bronze table and wants to ensure that it gets stored in a specific path in an external location. Which table can be created in this scenario?

  • AAn external table where the location is pointing to specific path in external location. (correct answer)
  • BAn external table where the schema has managed location pointing to specific path in external location.
  • CA managed table where the catalog has managed location pointing to specific path in external location.
  • DA managed table where the location is pointing to specific path in external location.
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: An external table where the location is pointing to specific path in external location.

Topic 1 Β· Question 142

Identify the impact of ON VIOLATION DROP ROW and ON VIOLATION FAIL UPDATE for a constraint violation. A data engineer has created an ETL pipeline using Delta Live table to manage their company travel reimbursement detail, they want to ensure that the if the location details has not been provided by the employee, the pipeline needs to be terminated. How can the scenario be implemented?

  • ACONSTRAINT valid_location EXPECT (location = NULL)
  • BCONSTRAINT valid_location EXPECT (location != NULL) ON VIOLATION FAIL UPDATE (correct answer)
  • CCONSTRAINT valid_location EXPECT (location != NULL) ON DROP ROW
  • DCONSTRAINT valid_location EXPECT (location != NULL) ON VIOLATION FAIL
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: CONSTRAINT valid_location EXPECT (location != NULL) ON VIOLATION FAIL UPDATE

Topic 1 Β· Question 143 Β· Select all that apply

Which two conditions are applicable for governance in Databricks Unity Catalog? (Choose two.)

  • AYou can have more than 1 metastore within a databricks account console but only 1 per region. (correct answer)
  • BBoth catalog and schema must have a managed location in Unity Catalog provided metastore is not associated with a location
  • CYou can have multiple catalogs within metastore and 1 catalog can be associated with multiple metastore
  • DIf catalog is not associated with location, it’s mandatory to associate schema with managed locations
  • EIf metastore is not associated with location, it’s mandatory to associate catalog with managed locations (correct answer)
Reveal answer & explanation
Correct answer: A, E

The correct answer is A, E. Option A: You can have more than 1 metastore within a databricks account console but only 1 per region. Option E: If metastore is not associated with location, it’s mandatory to associate catalog with managed locations

Topic 1 Β· Question 144

A data engineer needs to access the view created by the sales team, using a shared cluster. The data engineer has been provided usage permissions on the catalog and schema. In order to access the view created by sales team. What are the minimum permissions the data engineer would require in addition?

  • ANeeds SELECT permission on the VIEW and the underlying TABLE.
  • BNeeds SELECT permission only on the VIEW (correct answer)
  • CNeeds ALL PRIVILEGES on the VIEW
  • DNeeds ALL PRIVILEGES at the SCHEMA level
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: Needs SELECT permission only on the VIEW

Topic 1 Β· Question 145

Which method should a Data Engineer apply to ensure Workflows are being triggered on schedule?

  • AScheduled Workflows require an always-running cluster, which is more expensive but reduces processing latency.
  • BScheduled Workflows process data as it arrives at configured sources.
  • CScheduled Workflows can reduce resource consumption and expense since the cluster runs only long enough to execute the pipeline. (correct answer)
  • DScheduled Workflows run continuously until manually stopped.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Scheduled Workflows can reduce resource consumption and expense since the cluster runs only long enough to execute the pipeline.

Topic 1 Β· Question 146 Β· Select all that apply

The Delta transaction log for the β€˜students’ tables is shown using the β€˜DESCRIBE HISTORY students’ command. A Data Engineer needs to query the table as it existed before the UPDATE operation listed in the log. Which command should the Data Engineer use to achieve this? (Choose two.)

Exhibit 1 for question 146
  • ASELECT * FROM students@v4 (correct answer)
  • BSELECT * FROM students TIMESTAMP AS OF β€˜2024-04-22T 14:32:47.000+00:00’ (correct answer)
  • CSELECT * FROM students FROM HISTORY VERSION AS OF 3
  • DSELECT * FROM students VERSION AS OF 5
  • ESELECT * FROM students TIMESTAMP AS OF β€˜2024-04-22T 14:32:58.000+00:00’
Reveal answer & explanation
Correct answer: A, B

The correct answer is A, B. Option A: SELECT * FROM students@v4 Option B: SELECT * FROM students TIMESTAMP AS OF β€˜2024-04-22T 14:32:47.000+00:00’

Topic 1 Β· Question 147

An engineering manager uses a Databricks SQL query to monitor ingestion latency for each data source. The manager checks the results of the query every day, but they are manually rerunning the query each day and waiting for the results. Which of the following approaches can the manager use to ensure the results of the query are updated each day?

  • AThey can schedule the query to refresh every 1 day from the SQL endpoint's page in Databricks SQL.
  • BThey can schedule the query to refresh every 12 hours from the SQL endpoint's page in Databricks SQL.
  • CThey can schedule the query to refresh every 1 day from the query's page in Databricks SQL. (correct answer)
  • DThey can schedule the query to run every 12 hours from the Jobs UI.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: They can schedule the query to refresh every 1 day from the query's page in Databricks SQL.

Topic 1 Β· Question 148

A data engineer needs to apply custom logic to string column city in table stores for a specific use case. In order to apply this custom logic at scale, the data engineer wants to create a SQL user-defined function (UDF). Which of the following code blocks creates this SQL UDF?

  • A (correct answer)
  • B
  • C
  • D
Reveal answer & explanation
Correct answer: A

The correct answer is A. This option scales automatically to match demand.

Topic 1 Β· Question 149

A data engineer has realized that they made a mistake when making a daily update to a table. They need to use Delta time travel to restore the table to a version that is 3 days old. However, when the data engineer attempts to time travel to the older version, they are unable to restore the data because the data files have been deleted. Which of the following explains why the data files are no longer present?

  • AThe VACUUM command was run on the table (correct answer)
  • BThe TIME TRAVEL command was run on the table
  • CThe DELETE HISTORY command was run on the table
  • DThe OPTIMIZE command was nun on the table
Reveal answer & explanation
Correct answer: A

The correct answer is A. Option A: The VACUUM command was run on the table

Explanation

VACUUM removes old unreferenced Delta files after the retention period, reducing storage while preserving time-travel safety.

Topic 1 Β· Question 150

Which of the following describes the relationship between Bronze tables and raw data?

  • ABronze tables contain less data than raw data files.
  • BBronze tables contain more truthful data than raw data.
  • CBronze tables contain raw data with a schema applied. (correct answer)
  • DBronze tables contain a less refined view of data than raw data.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Bronze tables contain raw data with a schema applied.

Explanation

The bronze layer preserves raw ingested data for replay, auditing, and downstream refinement.

Topic 1 Β· Question 151

A data engineer only wants to execute the final block of a Python program if the Python variable day_of_week is equal to 1 and the Python variable review_period is True. Which of the following control flow statements should the data engineer use to begin this conditionally executed code block?

  • Aif day_of_week = 1 and review_period:
  • Bif day_of_week = 1 and review_period = "True":
  • Cif day_of_week = 1 & review_period: = "True":
  • Dif day_of_week == 1 and review_period: (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: if day_of_week == 1 and review_period:

Topic 1 Β· Question 152

Which of the following must be specified when creating a new Delta Live Tables pipeline?

  • AA key-value pair configuration
  • BAt least one notebook library to be executed (correct answer)
  • CA path to cloud storage location for the written data
  • DA location of a target database for the written data
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: At least one notebook library to be executed

Topic 1 Β· Question 153

In which of the following scenarios should a data engineer select a Task in the Depends On field of a new Databricks Job Task?

  • AWhen another task needs to be replaced by the new task
  • BWhen another task needs to successfully complete before the new task begins (correct answer)
  • CWhen another task has the same dependency libraries as the new task
  • DWhen another task needs to use as little compute resources as possible
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: When another task needs to successfully complete before the new task begins

Topic 1 Β· Question 154

A data engineering team has two tables. The first table march_transactions is a collection of all retail transactions in the month of March. The second table april_transactions is a collection of all retail transactions in the month of April. There are no duplicate records between the tables. Which of the following commands should be run to create a new table all_transactions that contains all records from march_transactions and april_transactions without duplicate records?

  • ACREATE TABLE all_transactions AS SELECT * FROM march_transactions INNER JOIN SELECT * FROM april_transactions;
  • BCREATE TABLE all_transactions AS SELECT * FROM march_transactions UNION SELECT * FROM april_transactions; (correct answer)
  • CCREATE TABLE all_transactions AS SELECT * FROM march_transactions OUTER JOIN SELECT * FROM april_transactions;
  • DCREATE TABLE all_transactions AS SELECT * FROM march_transactions INTERSECT SELECT * from april_transactions;
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: CREATE TABLE all_transactions AS SELECT * FROM march_transactions UNION SELECT * FROM april_transactions;

Topic 1 Β· Question 155

How can Git operations must be performed outside of Databricks Repos?

  • ACommit
  • BPull
  • CMerge (correct answer)
  • DClone
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: Merge

Topic 1 Β· Question 156

A data engineer has joined an existing project and they see the following query in the project repository: CREATE STREAMING LIVE TABLE loyal_customers AS SELECT customer_id - FROM STREAM(LIVE.customers) WHERE loyalty_level = 'high'; Which of the following describes why the STREAM function is included in the query?

  • AThe STREAM function is not needed and will cause an error.
  • BThe data in the customers table has been updated since its last run.
  • CThe customers table is a streaming live table. (correct answer)
  • DThe customers table is a reference to a Structured Streaming query on a PySpark DataFrame.
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: The customers table is a streaming live table. This option meets the real-time / low-latency performance requirement.

Topic 1 Β· Question 157

Which Structured Streaming query is performing a hop from a Silver table to a Gold table?

  • A
  • B
  • C
  • D (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. This option meets the real-time / low-latency performance requirement.

Topic 1 Β· Question 158

A data organization leader is upset about the data analysis team’s reports being different from the data engineering team’s reports. The leader believes the siloed nature of their organization’s data engineering and data analysis architectures is to blame. Which of the following describes how a data lakehouse could alleviate this issue?

  • ABoth teams would respond more quickly to ad-hoc requests
  • BBoth teams would use the same source of truth for their work (correct answer)
  • CBoth teams would reorganize to report to the same department
  • DBoth teams would be able to collaborate on projects in real-time
Reveal answer & explanation
Correct answer: B

The correct answer is B. Option B: Both teams would use the same source of truth for their work

Topic 1 Β· Question 159

A data analyst has developed a query that runs against Delta table. They want help from the data engineering team to implement a series of tests to ensure the data returned by the query is clean. However, the data engineering team uses Python for its tests rather than SQL. Which of the following operations could the data engineering team use to run the query and operate with the results in PySpark?

  • ASELECT * FROM sales
  • Bspark.delta.table
  • Cspark.sql (correct answer)
  • Dspark.table
Reveal answer & explanation
Correct answer: C

The correct answer is C. Option C: spark.sql

Topic 1 Β· Question 160

A data engineer has a Job that has a complex run schedule, and they want to transfer that schedule to other Jobs. Rather than manually selecting each value in the scheduling form in Databricks, which of the following tools can the data engineer use to represent and submit the schedule programmatically?

  • Apyspark.sql.types.DateType
  • Bdatetime
  • Cpyspark.sql.types.TimestampType
  • DCron syntax (correct answer)
Reveal answer & explanation
Correct answer: D

The correct answer is D. Option D: Cron syntax

Showing questions 141–160 of 169 Β· Page 8 of 9