Which of the following is an example of a clustering problem that can be resolved by unsupervised learning?
Correct Answer: A
The syllabus defines clustering as: "Clustering: This is when the problem requires the identification of similarities in input data points that allows them to be grouped based on common characteristics or attributes. For example, clustering is used to categorize different types of customers for the purpose of marketing." (Reference: ISTQB CT-AI Syllabus v1.0, Section 3.1.2, page 26 of 99)
Question 17
Consider a natural language processing (NLP) algorithm that attempts to predict the next word that you would like to type in a text message. An update to the algorithm has been created that should increase the accuracy of the predictions based on user typing patterns. The old algorithm was rated for accuracy by the users. Then, after the new update was released, the users rated the updated algorithm. A statistical test was used to compare between the two versions of the algorithm to see whether or not the update should remain in place. This is an example of what type of testing?
Correct Answer: B
A/B testing is a statistical testing method that compares two different versions of a system to determine which one performs better. In this scenario, theold NLP algorithmwas rated for accuracy, and after the update, the new algorithmwas also rated by users. A statistical test was performed to compare the two versions, which is the fundamental approach ofA/B testing. A/B testing is commonly used in: * User experience testing(e.g., comparing different versions of a website). * ML model evaluation(e.g., comparing two AI-based classifiers). * Performance assessment(e.g., determining if a new recommendation algorithm is more effective). This approach allows for data-driven decisions, ensuring that any changes to the system result in meaningful improvements. * Section 9.4 - A/B Testingstates that A/B testing is used to compare updates in AI-based systems to determine if the newer version is better. Reference from ISTQB Certified Tester AI Testing Study Guide:
Question 18
Which of the following statements about explainable AI is correct? Choose ONE option (1 out of 4)
Correct Answer: C
Section2.10 - Explainability and Transparencyof the ISTQB CT-AI syllabus describes explainable AI as the ability of a system to provide human-understandable insight into its decisions. The syllabus referencesThe Royal Society's reportas a foundational source explaining why explainability is important. Among the stated motivations is the need toincrease user trust and confidencein AI systems by making their decisions understandable and justifiable. Therefore, OptionCdirectly reflects the syllabus content . Option A is incorrect because interpretability doesnotrefer to determining correctness of outputs; rather, it refers to understandinghowthe model arrives at outputs. Option B incorrectly frames explainability as the ability to investigate algorithms or training data; explainability is aboutunderstanding the model's decision- making, not reverse engineering its components. Option D is incorrect because explainability doesnot eliminate the need for risk and vulnerability assessments; the syllabus clearly emphasizes that testing, risk assessment, and robustness checks remain critical even when a model is explainable. Thus, the only statement consistent with the syllabus isOption C.
Question 19
Which of the following statements about ML functional performance metrics is correct? Choose ONE option (1 out of 4)
Correct Answer: A
The ISTQB CT-AI syllabus explains ML performance metrics in Section3.2 - Evaluating ML Models. For clustering, which is an unsupervised learning method, the syllabus lists metrics such asintra-cluster distance, inter-cluster distance, and coherence measures. Intra-cluster metrics evaluate how close data points are within a cluster, which directly corresponds to Option A. Option B is incorrect becauseR-squaredis a regression metric measuring goodness-of-fit, not classification performance, and has no connection to ROC curves. Option C is wrong because thesilhouette coefficientis also a clustering metric, measuring cohesion vs. separation-not regression accuracy. Option D is incorrect because ROC curves evaluatebinary or multiclass classification, not clustering. Thus, OptionAis the only accurate statement based on the syllabus.
Question 20
Which of the following are the three activities in the data acquisition activities for data preparation?
Correct Answer: C
The syllabus defines data acquisition as consisting of three steps: "Data acquisition: The activity of acquiring data relevant to the business problem to be solved by an ML model, typically involving the activities of identifying, gathering and labelling data."