Databricks Certified Data Engineer Professional Sample Questions:

1. A data engineer has created a new cluster using shared access mode with default configurations.
The data engineer needs to allow the development team access to view the driver logs if needed.
What are the minimal cluster permissions that allow the development team to accomplish this?

A) CAN RESTART
B) CAN VIEW
C) CAN ATTACH TO
D) CAN MANAGE

2. A data engineer is implementing a job to download multiple PDF files from a third-party provided REST API endpoint by specifying different report types. The REST API is time-consuming and encounters intermittent errors, so the engineer wants to track each download activity to know when it fails and to retry partially, while providing scalable throughput. The engineer needs to download ten report types, and the list can be changed over time. How should the data engineer achieve this?

A) Use a foreach task with a list of report types as its inputs.
B) Define ten Notebook tasks to clearly track which report download failed.
C) Use a Delta Lake table to track each report download status as 10 rows, and use it as a source table to execute the download function as a Pandas UDF.
D) Define a list variable within a Notebook to loop through the report types to download them, and print the download results. Execute it as a Notebook tasks.

3. Which statement describes a key benefit of an end-to-end test?

A) It closely simulates real world usage of your application.
B) It makes it easier to automate your test suite
C) It pinpoint errors in the building blocks of your application.
D) It provides testing coverage for all code paths and branches.

4. The data engineering team has configured a job to process customer requests to be forgotten (have their data deleted). All user data that needs to be deleted is stored in Delta Lake tables using default table settings.
The team has decided to process all deletions from the previous week as a batch job at 1am each Sunday. The total duration of this job is less than one hour. Every Monday at 3am, a batch job executes a series of VACUUM commands on all Delta Lake tables throughout the organization.
The compliance officer has recently learned about Delta Lake's time travel functionality. They are concerned that this might allow continued access to deleted data.
Assuming all delete logic is correctly implemented, which statement correctly addresses this concern?

A) Because Delta Lake time travel provides full access to the entire history of a table, deleted records can always be recreated by users with full admin privileges.
B) Because the default data retention threshold is 7 days, data files containing deleted records will be retained until the vacuum job is run 8 days later.
C) Because the default data retention threshold is 24 hours, data files containing deleted records will be retained until the vacuum job is run the following day.
D) Because Delta Lake's delete statements have ACID guarantees, deleted records will be permanently purged from all storage systems as soon as a delete job completes.
E) Because the vacuum command permanently deletes all files containing deleted records, deleted records may be accessible with time travel for around 24 hours.

5. In order to facilitate near real-time workloads, a data engineer is creating a helper function to leverage the schema detection and evolution functionality of Databricks Auto Loader. The desired function will automatically detect the schema of the source directly, incrementally process JSON files as they arrive in a source directory, and automatically evolve the schema of the table when new fields are detected.
The function is displayed below with a blank:

Which response correctly fills in the blank to meet the specified requirements?

A)

B)

C)

D)

E)

Solutions: