Which of the following decisions is BEST as a test approach for the described situation? Choose ONE option (1 out of 4)
Correct Answer: C
The ISTQB CT-AI syllabus emphasizes that testing AI-based systems requirescross-functional collaboration andexperience-based testingwhen parts of the team lack domain knowledge. In this scenario, the ML expert understands ML and dataset preparation but lacks knowledge ofcamera system behavior, the device's operational data pipeline, and end-user workflows. The remainder of the team understands the domain and system testing but not ML. Section4.4 - Human Factors and AI Testingand4.3 - System Testing of AI Componentshighlight that when domain understanding is unevenly distributed,experience-based testing conducted by the full team(testers, developers, domain experts) is the most effective approach. This ensures that AI outputs align with actual user expectations and system behavior. OptionCaligns exactly with this principle. Option A is too limited and does not address the need to validate ML integration. Option B is incorrect because reusing old test cases overlooks AI-specific risks in the operating data pipeline. Option D is useful but focuses only on data representativeness, not system-level user validation. Therefore,Option Cis the best, syllabus-aligned test approach.
Question 17
Which statement regarding flexibility and adaptability of AI-based systems is correct? Choose ONE option (1 out of 4)
Correct Answer: A
The ISTQB CT-AI syllabus defines these two concepts clearly inSection 2.1 - Flexibility and Adaptability. Flexibility is described as the ability of a system to operate in situationsnot explicitly covered in its original requirements, while adaptability refers to how easily the system can bemodifiedto handle new environments or conditions. The syllabus stresses that both flexibility and adaptability are crucial, particularly inself- learning AI systemsthat may need to respond to changes in their environment and adjust their behavior accordingly. It states that systems must be capable of determiningwhenandhowto adjust behavior in evolving situations, especially when the operational environment is not fully known at deployment time . This directly aligns with OptionA. Option B reverses definitions-the syllabus states flexibility (not adaptability) relates to unspecified situations. Option C is incorrect: self-learning systems requirebothflexibility and adaptability; they are not categorized as one or the other. Option D incorrectly defines flexibility; the syllabus defines adaptability-not flexibility-as ease of modification. Thus,Option Acorrectly reflects the syllabus.
Question 18
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase? SELECT ONE OPTION
Correct Answer: C
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option: Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics. Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected. Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained. Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real-time applications. Reference: ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
Question 19
Which of the following is a technique used in machine learning?
Correct Answer: A
Decision trees are a widely usedmachine learning (ML) techniquethat falls undersupervised learning. They are used for bothclassification and regressiontasks and are popular due to their interpretability and effectiveness. * How Decision Trees Work: * The model splits the dataset into branches based on feature conditions. * It continues to divide the data until each subset belongs to a single category (classification) or predicts a continuous value (regression). * The final result is a tree structure where decisions are made atnodes, and predictions are given at leaf nodes. * Common Applications of Decision Trees: * Fraud detection * Medical diagnosis * Customer segmentation * Recommendation systems * B (Equivalence Partitioning):This is asoftware testing technique, not a machine learning method. It is used to divide input data into partitions to reduce test cases while maintaining coverage. * C (Boundary Value Analysis):Anothersoftware testing technique, used to check edge cases around input boundaries. * D (Decision Tables):A structuredtesting techniqueused to validate business rules and logic, not a machine learning method. * ISTQB CT-AI Syllabus (Section 3.1: Forms of Machine Learning - Decision Trees) * "Decision trees are used in classification and regression models and are fundamental ML algorithms". Why Other Options Are Incorrect:Supporting References from ISTQB Certified Tester AI Testing Study Guide:Conclusion:Sincedecision trees are a core technique in machine learning, while the other options are software testing techniques, thecorrect answer is A.
Question 20
A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will repay the loan or not. The bank has enough data on past customers to randomly split the data into a training data set and a test /validation data set. A logistic regression model is constructed on the training data set using the following independent variables: Gender Marital status Number of dependents Education Income Loan amount Loan term Credit score The model reveals that those with higher credit scores and larger total incomes are more likely to repay their loans. The data scientist has suggested that there might be bias present in the model based on previous models created for other banks. Given this information, what is the best test approach to check for potential bias in the model?
Correct Answer: A
Bias in an AI system occurs when the training data contains inherent prejudices that cause the model to make unfair predictions. Experience-based testing, particularlyExploratory Data Analysis (EDA), helps uncover these biases by analyzing patterns, distributions, and potential discriminatory factors in the training data. * Option A:"Experience-based testing should be used to confirm that the training data set is operationally relevant. This can include applying exploratory data analysis (EDA) to check for bias within the training data set." * This is the correct answer. EDA involves examining the dataset for bias, inconsistencies, or missing values, ensuring fairness in ML model predictions. * Option B:"Back-to-back testing should be used to compare the model created using the training data set to another model created using the test data set. If the two models significantly differ, it will indicate there is bias in the original model." * Back-to-back testing is used for regression testing and to compare versions of an AI system but is not primarily used to detect bias. * Option C:"Acceptance testing should be used to make sure the algorithm is suitable for the customer. The team can re-work the acceptance criteria such that the algorithm is sure to correctly predict the remaining applicants that have been set aside for the validation data set ensuring no bias is present." * Acceptance testing focuses on meeting predefined business requirements rather than detecting and mitigating bias. * Option D:"A/B testing should be used to verify that the test data set does not detect any bias that might have been introduced by the original training data. If the two models significantly differ, it will indicate there is bias in the original model." * A/B testing is used for evaluating variations of a model rather than for explicitly identifying bias. * Bias Testing Methods:"AI-based systems should be tested for algorithmic bias, sample bias, and inappropriate bias. Experience-based testing and EDA are useful for detecting bias". * Exploratory Data Analysis (EDA):"EDA helps uncover potential bias in training data through visualization and statistical analysis". Analysis of the Answer Options:ISTQB CT-AI Syllabus References:Thus,Option A is the best choice for detecting bias in the loan applicant model.