Online Access Free Databricks-Certified-Data-Engineer-Professional Practice Test

Each configuration below is identical to the extent that each cluster has 400 GB total of RAM 160 total cores and only one Executor per VM.
Given an extremely long-running job for which completion must be guaranteed, which cluster configuration will be able to guarantee completion of the job in light of one or more VM failures?

• A.- Total VMs: 8
  - 50 GB per Executor
  - 20 Cores / Executor
• B.- Total VMs: 4
  - 100 GB per Executor
  - 40 Cores / Executor
• C.- Total VMs: 16
  - 25 GB per Executor
  - 10 Cores / Executor
• D.- Total VMs: 1
  - 400 GB per Executor
  - 160 Cores/Executor
• E.- Total VMs: 2
  - 200 GB per Executor
  - 80 Cores / Executor

A data engineer wants to refactor the following DLT code, which includes multiple table definitions with very similar code.

In an attempt to programmatically create these tables using a parameterized table definition, the data engineer writes the following code.

The pipeline runs an update with this refactored code, but generates a different DAG showing incorrect configuration values for these tables.
How can the data engineer fix this?

• A.Load the configuration values for these tables from a separate file, located at a path provided by a pipeline parameter.
• B.Convert the list of configuration values to a dictionary of table settings, using different input the for loop.
• C.Convert the list of configuration values to a dictionary of table settings, using table names as keys.
• D.Wrap the loop inside another table definition, using generalized names and properties to replace with those from the inner table

The data engineer is using Spark's MEMORY_ONLY storage level. Which indicators should the data engineer look for in the spark UI's Storage tab to signal that a cached table is not performing optimally?

• A.The number of Cached Partitions> the number of Spark Partitions
• B.Size on Disk is> 0
• C.Size on Disk is < Size in Memory
• D.On Heap Memory Usage is within 75% of off Heap Memory usage
• E.The RDD Block Name included the '' annotation signaling failure to cache

What describes a primary technical challenge in ensuring consistent PII masking across all nodes in large-scale, distributed Databricks batch and streaming pipelines?

• A.Dynamic data masking is applied only at rest, so it does not affect query performance.
• B.Masking functions must be standardized and managed through Unity Catalog, with enforcement applied across all relevant datasets to avoid any data inconsistency.
• C.PII masking is only required for direct identifiers.
• D.Native masking in Databricks automatically synchronizes with all downstream external Databricks systems.

A Delta table of weather records is partitioned by date and has the below schema:
date DATE, device_id INT, temp FLOAT, latitude FLOAT, longitude FLOAT
To find all the records from within the Arctic Circle, you execute a query with the below filter:
latitude > 66.3
Which statement describes how the Delta engine identifies which files to load?

• A.The Hive metastore is scanned for min and max statistics for the latitude column
• B.All records are cached to an operational database and then the filter is applied
• C.The Parquet file footers are scanned for min and max statistics for the latitude column
• D.The Delta log is scanned for min and max statistics for the latitude column
• E.All records are cached to attached storage and then the filter is applied