Question 51
CASE STUDY
Please use the following to answer the next question:
A leading insurance provider that offers a range of coverage options to individuals has decided to utilize AI to streamline and improve its customer acquisition and underwriting process, including the accuracy and efficiency of pricing policies. The company has engaged a cloud provider to utilize and fine-tune its pre-trained, general purpose large language model ("LLM").
The company intends to use its historical customer data - including applications, policies and claims - and proprietary pricing and risk strategies to provide an initial qualification assessment of potential customers, which would then be routed to a human underwriter for final review.
The company and the cloud provider have completed training and testing the LLM, performed a readiness assessment, and made the decision to deploy the LLM into production. They have designated an internal compliance team to monitor the model during the first month, specifically to evaluate the accuracy, fairness and reliability of its output.
After the first month in production, the company realizes that the LLM declines a higher percentage of women's applications.
Each of the following steps would support fairness testing by the compliance team during the first month in production EXCEPT:
Please use the following to answer the next question:
A leading insurance provider that offers a range of coverage options to individuals has decided to utilize AI to streamline and improve its customer acquisition and underwriting process, including the accuracy and efficiency of pricing policies. The company has engaged a cloud provider to utilize and fine-tune its pre-trained, general purpose large language model ("LLM").
The company intends to use its historical customer data - including applications, policies and claims - and proprietary pricing and risk strategies to provide an initial qualification assessment of potential customers, which would then be routed to a human underwriter for final review.
The company and the cloud provider have completed training and testing the LLM, performed a readiness assessment, and made the decision to deploy the LLM into production. They have designated an internal compliance team to monitor the model during the first month, specifically to evaluate the accuracy, fairness and reliability of its output.
After the first month in production, the company realizes that the LLM declines a higher percentage of women's applications.
Each of the following steps would support fairness testing by the compliance team during the first month in production EXCEPT:
Question 52
CASE STUDY
A global marketing agency is adapting a large language model ("LLM") to generate content for an upcoming marketing campaign for a client's new product: a hard hat designed for construction workers of any gender to better protect them from head injuries.
The marketing agency is accessing the LLM through an application programming interface ("API") developed by a third-party technology company. They want to generate text to be used for targeted advertising communications that highlight the benefits of the hard hat to potential purchasers. Both the marketing agency and the technology company have taken reasonable steps to address Al governance.
The marketing company has:
* Entered into a contract with the technology company with suitable representations and warranties.
* Completed an impact assessment on the LLM for this intended use.
* Built technical guidance on how to measure and mitigate bias in the LLM.
* Enabled technical aspects of transparency, explainability, robustness and privacy.
* Followed applicable regulatory requirements.
* Created specific legal statements and disclosures regarding the use of the Al on its client's advertising.
The technology company has:
* Provided guidance and resources to developers to address environmental concerns.
* Build technical guidance on how to measure and mitigate bias in the LLM.
* Provided tools and resources to measure bias specific to the LLM.
* Enabled technical aspects of transparency, explainability, robustness and privacy.
* Mapped and mitigated potential societal harms and large-scale impacts.
* Followed applicable regulatory requirements and industry standards.
* Created specific legal statements and disclosures regarding the LLM. including with respect to IP and rights to data.
Which stakeholder is responsible for the lawful collection of data used to train the foundational AI model?
A global marketing agency is adapting a large language model ("LLM") to generate content for an upcoming marketing campaign for a client's new product: a hard hat designed for construction workers of any gender to better protect them from head injuries.
The marketing agency is accessing the LLM through an application programming interface ("API") developed by a third-party technology company. They want to generate text to be used for targeted advertising communications that highlight the benefits of the hard hat to potential purchasers. Both the marketing agency and the technology company have taken reasonable steps to address Al governance.
The marketing company has:
* Entered into a contract with the technology company with suitable representations and warranties.
* Completed an impact assessment on the LLM for this intended use.
* Built technical guidance on how to measure and mitigate bias in the LLM.
* Enabled technical aspects of transparency, explainability, robustness and privacy.
* Followed applicable regulatory requirements.
* Created specific legal statements and disclosures regarding the use of the Al on its client's advertising.
The technology company has:
* Provided guidance and resources to developers to address environmental concerns.
* Build technical guidance on how to measure and mitigate bias in the LLM.
* Provided tools and resources to measure bias specific to the LLM.
* Enabled technical aspects of transparency, explainability, robustness and privacy.
* Mapped and mitigated potential societal harms and large-scale impacts.
* Followed applicable regulatory requirements and industry standards.
* Created specific legal statements and disclosures regarding the LLM. including with respect to IP and rights to data.
Which stakeholder is responsible for the lawful collection of data used to train the foundational AI model?
Question 53
A company has developed a proprietary AI model that analyzes consumer online behavior and predicts what prices consumers would be willing to pay for certain products, so that retailers may modify pricing accordingly. To test the model, the company has:
- Performed an impact assessment.
- Conducted repeatability tests.
- Exposed the model to edge cases and potential malicious input.
- Conducted adversarial testing to ID security threats.
- Assessed and mitigated discrimination risks.
Which additional responsible AI principle has the company failed to assess?
- Performed an impact assessment.
- Conducted repeatability tests.
- Exposed the model to edge cases and potential malicious input.
- Conducted adversarial testing to ID security threats.
- Assessed and mitigated discrimination risks.
Which additional responsible AI principle has the company failed to assess?
Question 54
CASE STUDY
Please use the following answer the next question:
A mid-size US healthcare network has decided to develop an Al solution to detect a type of cancer that is most likely arise in adults. Specifically, the healthcare network intends to create a recognition algorithm that will perform an initial review of all imaging and then route records a radiologist for secondary review pursuant agreed-upon criteria (e.g., a confidence score below a threshold).
To date, the healthcare network has taken the following steps: defined its Al ethical principles: conducted discovery to identify the intended uses and success criteria for the system: established an Al governance committee; assembled a broad, crossfunctional team with clear roles and responsibilities; and created policies and procedures to document standards, workflows, timelines and risk thresholds during the project.
The healthcare network intends to retain a cloud provider to host the solution and a consulting firm to help develop the algorithm using the healthcare network ' s existing data and de-identified data that is licensed from a large US clinical research partner.
In the design phase, what is the most important step for the healthcare network to take when mapping its existing data to the clinical research partner data?
Please use the following answer the next question:
A mid-size US healthcare network has decided to develop an Al solution to detect a type of cancer that is most likely arise in adults. Specifically, the healthcare network intends to create a recognition algorithm that will perform an initial review of all imaging and then route records a radiologist for secondary review pursuant agreed-upon criteria (e.g., a confidence score below a threshold).
To date, the healthcare network has taken the following steps: defined its Al ethical principles: conducted discovery to identify the intended uses and success criteria for the system: established an Al governance committee; assembled a broad, crossfunctional team with clear roles and responsibilities; and created policies and procedures to document standards, workflows, timelines and risk thresholds during the project.
The healthcare network intends to retain a cloud provider to host the solution and a consulting firm to help develop the algorithm using the healthcare network ' s existing data and de-identified data that is licensed from a large US clinical research partner.
In the design phase, what is the most important step for the healthcare network to take when mapping its existing data to the clinical research partner data?
Question 55
Your company is developing an AI system for global markets. This system involves personal data processing and some decision making that may affect rights of the individuals. Part of your role as an AI governance professional is to ensure the AI system complies with various international regulatory requirements. Which of the following approaches best aligns with a comprehensive understanding of and compliance with AI regulatory requirements in this scenario?