Question 96

A data organization has adopted Delta Sharing to securely distribute curated datasets from a Unity Catalog-enabled workspace. The data engineering team shares large Delta tables internally via Databricks-to-Databricks and externally via Open Sharing for aggregated reports. While testing, they encounter challenges related to access control, data update visibility, and shareable object types.
What is a limitation of the Delta Sharing protocol or implementation when used with Databricks-to-Databricks or Open Sharing?
  • Question 97

    A Delta Lake table in the Lakehouse named customer_parsams is used in churn prediction by the machine learning team. The table contains information about customers derived from a number of upstream sources.
    Currently, the data engineering team populates this table nightly by overwriting the table with the current valid values derived from upstream data sources.
    Immediately after each update succeeds, the data engineer team would like to determine the difference between the new version and the previous of the table.
    Given the current implementation, which method can be used?
  • Question 98

    What is the main difference between the bronze layer and silver layer in a medallion architecture?
  • Question 99

    To identify the top users consuming compute resources, a data engineering team needs to monitor usage within their Databricks workspace for better resource utilization and cost control. The team decided to use Databricks system tables, available under the System catalog in Unity Catalog, to gain detailed visibility into workspace activity.
    Which SQL query should the team run from the System catalog to achieve this?
  • Question 100

    While reviewing a query's execution in the Databricks Query Profiler, a data engineer observes that the Top Operators panel shows a Sort operator with high Time Spent and Memory Peak metrics. The Spark UI also reports frequent data spilling.
    How should the data engineer address this issue?