Which statement describes factors related to test data that make testing AI-based systems difficult? Choose ONE option (1 out of 4)
Correct Answer: B
Section2.2 - Data Preparationand4.1 - Challenges in Testing AI-Based Systemsdescribe difficulties in obtaining and managing large, representative datasets. AI-based systems requirerealistic, diverse, and representativedata reflecting real-world variations. The syllabus emphasizes that assembling such datasets is time-consuming, resource-intensive, and often constrained by availability, privacy, or domain complexity. Option B directly corresponds to these documented challenges. Option A is incorrect: using the same implementation risksdefect masking, not preventing it; the syllabus warns against this practice. Option C is incorrect because real-world data naturally evolves, and the syllabus notes thatdriftis normal; expecting stable input data contradicts operational reality. Option D is incorrect: although data privacy is important, the syllabus does not claim that artificially generated data always requires legal approval, nor that sanitization/encryption is mandatory for synthetic data. Thus,Option Baccurately reflects syllabus-defined difficulties in producing representative test data.
Question 82
The training of an ML model... What type of bias is LEAST important to look for when testing the model?
Correct Answer: B
The ISTQB CT-AI syllabus distinguishes between several types of bias relevant in AI testing, includingsample bias,algorithmic bias, andinappropriate bias. In Section3.3 - Bias in AI-Based Systems, the syllabus stresses the importance of identifying biases that originate fromtraining data,model development, anddecision logic. Sample bias occurs when the training data does not adequately represent the population; algorithmic bias arises when the model produces systematically skewed results due to learned patterns; inappropriate bias involves ethically or socially problematic distortions in the outcomes. All three of these bias types directly affect theoutputs of the AI modeland are therefore highly relevant when testing an industrial inspection system intended to reliably detect defects. These biases can lead to defective items being missed or false alarms being raised, which impacts quality assurance significantly . Automation bias, however, is fundamentally different. It refers to ahuman cognitive bias, where users (e.g., inspectors) overly trust or rely on the AI system's output. While important in user- interaction testing, it isnota biaswithin the ML model itself. Since the question asks which bias isleast important when testing the model, automation bias can be legitimately deprioritized duringmodel-level testing. Therefore, Option B is correct.
Question 83
A transportation company operates three types of delivery vehicles in its fleet. The vehicles operate at different speeds (slow, medium, and fast). The transportation company is attempting to optimize scheduling and has created an AI-based program to plan routes for its vehicles using records from the medium-speed vehicle traveling to selected destinations. The test team uses this data in metamorphic testing to test the accuracy of the estimated travel times created by the AI route planner with the actual routes and times. Which of the following describes the next phase of metamorphic testing?
Correct Answer: A
The syllabus describes metamorphic testing as: "Testing involves defining metamorphic relations and then applying those relations to check that the transformations result in expected outcomes, even when the expected output of the system is unknown or not well-defined." In this scenario, applying the metamorphic relation (speed differences) and checking the transformed outcome (arrival times) fits the definition of metamorphic testing. (Reference: ISTQB CT-AI Syllabus v1.0, Section 9.5, page 69 of 99)
Question 84
Which of the following is an example of a clustering problem that can be resolved by unsupervised learning?
Correct Answer: A
Clustering is a form ofunsupervised learning, which groups data points based onsimilarities without predefined labels. According toISTQB CT-AI Syllabus, clustering is used in scenarios where: * The objective is to find natural groupings in data. * The dataset does not have labeled outputs. * Patterns and structures need to be identified automatically. Analyzing the answer choices: * A. Associating shoppers with their shopping tendencies # Correct * Shoppers can be grouped based on purchasing behaviors(e.g., luxury shoppers vs. budget- conscious shoppers), which is a typical clustering application in market segmentation. * B. Grouping individual fish together based on their types of fins # Incorrect * If thetypes of fins are labeled, it becomes aclassification problem, which requires supervised learning. * C. Classifying muffin purchases based on packaging attractiveness # Incorrect * Classification, not clustering, because attractiveness scores or labels must be predefined. * D. Estimating the expected purchase of cat food after an ad campaign # Incorrect * This is a prediction task, best suited forregression models, which are part of supervised learning. Thus,Option A is the best answer, asclusteringis used togroup shoppers based on tendencies without predefined labels. Certified Tester AI Testing Study Guide References: * ISTQB CT-AI Syllabus v1.0, Section 3.1.2 (Unsupervised Learning - Clustering and Association) * ISTQB CT-AI Syllabus v1.0, Section 3.3 (Selecting a Form of ML - Clustering).
Question 85
There is a growing backlog of unresolved defects for your project. You know the developers have an ML model that they have created which has learned which developers work on which type of software and the speed with which they resolve issues. How could you use this model to help reduce the backlog and implement more efficient defect resolution?
Correct Answer: B
AI and ML models can play a significant role in optimizing defect resolution processes. According to the ISTQB Certified Tester AI Testing (CT-AI) Syllabus, ML models can be used toanalyze defect reports, prioritize critical defects, and assign defects to developersbased on historical defect resolution patterns. The key AI applications for defect management include: * Defect Categorization- NLP techniques can analyze defect reports and classify them based on metadata like severity and impact. * Defect Prioritization- ML models trained on past defects can predict which issues are likely to cause failures, allowing teams toprioritizethe most critical issues. * Defect Assignment- AI-based models can suggest which developers are best suited for specific defects, optimizing the resolution process based on past performance and specialization. From the given answer choices: * Option A (Automatic Prioritization)is useful but does not directlyreduce backlog efficientlyby considering developer expertise and workload balancing. * Option C (Root Cause Analysis for Process Improvement)is along-term strategybut does not directly address backlog reduction. * Option D (Defect Prediction for Testing Focus)helps preemptively identify issues but does not resolve the existing backlog. Thus,Option Bis the best choice as it aligns with AI's capability toassign defects to the most suitable developersbased on historical data, ensuring efficient defect resolution and backlog reduction. Certified Tester AI Testing Study Guide References: * ISTQB CT-AI Syllabus v1.0, Section 11.2 (Using AI to Analyze Reported Defects) * ISTQB CT-AI Syllabus v1.0, Section 11.5 (Using AI for Defect Prediction).