AWS Certified Data Engineer - Associate DEA-C01 — Topic 1 Question 244

Question

A data engineer is configuring an AWS Glue Apache Spark extract, transform, and load (ETL) job. The job contains a sort-merge join of two large and equally sized DataFrames. The job is failing with the following error: No space left on device. Which solution will resolve the error?

Accepted Answer

Correct answer: A. The correct answer is A. Option A: Use the AWS Glue Spark shuffle manager. AWS Glue is a serverless ETL and data-catalog service that prepares and integrates data.

AWS Certified Data Engineer - Associate DEA-C01 — Question 244