Question 41

You are asked to setup two tasks in a databricks job, the first task runs a notebook to download the data from a remote system, and the second task is a DLT pipeline that can process this data, how do you plan to configure this in Jobs UI
  • Question 42

    In order to facilitate near real-time workloads, a data engineer is creating a helper function to leverage the schema detection and evolution functionality of Databricks Auto Loader. The desired function will automatically detect the schema of the source directly, incrementally process JSON files as they arrive in a source directory, and automatically evolve the schema of the table when new fields are detected.
    The function is displayed below with a blank:

    Which response correctly fills in the blank to meet the specified requirements?
  • Question 43

    A Databricks job has been configured with 3 tasks, each of which is a Databricks notebook. Task A does not depend on other tasks. Tasks B and C run in parallel, with each having a serial dependency on task A.
    If tasks A and B complete successfully but task C fails during a scheduled run, which statement describes the resulting state?
  • Question 44

    A data engineer needs to create a database called customer360 at the loca-tion /customer/customer360. The
    data engineer is unsure if one of their colleagues has already created the database.
    Which of the following commands should the data engineer run to complete this task?
  • Question 45

    Consider flipping a coin for which the probability of heads is p, where p is unknown, and our goa is to
    estimate p. The obvious approach is to count how many times the coin came up heads and divide by the total
    number of coin flips. If we flip the coin 1000 times and it comes up heads 367 times, it is very reasonable to
    estimate p as approximately 0.367. However, suppose we flip the coin only twice and we get heads both times.
    Is it reasonable to estimate p as 1.0? Intuitively, given that we only flipped the coin twice, it seems a bit
    rash to conclude that the coin will always come up heads, and____________is a way of avoiding such rash
    conclusions.