Question 1

A data engineer needs to apply custom logic to identify employees with more than 5 years of experience in array column employees in table stores. The custom logic should create a new column exp_employees that is an array of all of the employees with more than 5 years of experience for each row. In order to apply this custom logic at scale, the data engineer wants to use the FILTER higher-order function.
Which of the following code blocks successfully completes this task?
  • Question 2

    Which of the following describes the relationship between Gold tables and Silver tables?
  • Question 3

    A dataset has been defined using Delta Live Tables and includes an expectations clause:
    CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION DROP ROW What is the expected behavior when a batch of data containing data that violates these constraints is processed?
  • Question 4

    A data engineer needs access to a table new_table, but they do not have the correct permissions. They can ask the table owner for permission, but they do not know who the table owner is.
    Which of the following approaches can be used to identify the owner of new_table?
  • Question 5

    An engineering manager uses a Databricks SQL query to monitor ingestion latency for each data source. The manager checks the results of the query every day, but they are manually rerunning the query each day and waiting for the results.
    Which of the following approaches can the manager use to ensure the results of the query are updated each day?