Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters? SELECT ONE OPTION
Correct Answer: C
Setting model and algorithm hyperparameters is an essential step in the machine learning workflow, primarily occurring during the tuning phase. Evaluating the model (A): This stage involves assessing the model's performance using metrics and does not typically include the setting of hyperparameters. Deploying the model (B): Deployment is the stage where the model is put into production and used in real-world applications. Hyperparameters should already be set before this stage. Tuning the model (C): This is the correct stage where hyperparameters are set. Tuning involves adjusting the hyperparameters to optimize the model's performance. Data testing (D): Data testing involves ensuring the quality and integrity of the data used for training and testing the model. It does not include setting hyperparameters. Hence, the most appropriate stage of the ML workflow to set model and algorithm hyperparameters is C. Tuning the model. Reference: ISTQB CT-AI Syllabus Section 3.2 on the ML Workflow outlines the different stages of the ML process, including the tuning phase where hyperparameters are set. Sample Exam Questions document, Question #31 specifically addresses the stage in the ML workflow where hyperparameters are configured.
Question 127
Which of the following technologies for implementing AI is considered to be a reasoning technique? Choose ONE option (1 out of 4)
Correct Answer: A
TheISTQB Certified Tester AI Testing Syllabus v1.0explicitly categorizes different AI implementation technologies in Section1.4 - AI Technologies. Within this section, AI methods are grouped into categories, one of which is"Reasoning techniques."These reasoning techniques includerule engines, deductive classifiers, case-based reasoning, and procedural reasoning. Because deductive classifiers are directly listed under this set of reasoning approaches, they are recognized as a reasoning-based AI technology. Reasoning techniques differ from machine learning approaches because they rely onstructured, predefined rules or logicto reach conclusions. Deductive classifiers use logical inference and symbolic reasoning to classify inputs by applying encoded knowledge. This makes them fundamentally different from statistical or data-driven ML algorithms. The other options-Linear regression,Random Forest, andGenetic algorithms-are listed by the syllabus asmachine learning techniques, not reasoning methods. Linear regression performs numerical prediction, Random Forest is an ensemble decision-tree ML model, and genetic algorithms are optimization-based ML approaches inspired by evolutionary processes. None of these involve symbolic logical deduction. Thus, based on the authoritative definitions in the syllabus,Deductive classifiers (Option A)is the only technology classified as a reasoning technique.
Question 128
A transportation company operates three types of delivery vehicles in its fleet. The vehicles operate at different speeds (slow, medium, and fast). The transportation company is attempting to optimize scheduling and has created an AI-based program to plan routes for its vehicles using records from the medium-speed vehicle traveling to selected destinations. The test team uses this data in metamorphic testing to test the accuracy of the estimated travel times created by the AI route planner with the actual routes and times. Which of the following describes the next phase of metamorphic testing?
Correct Answer: A
Metamorphic Testing (MT)is a testing technique that verifies AI-based systems by generatingfollow-up test casesbased on existing test cases. These follow-up test cases adhere to aMetamorphic Relation (MR), ensuring that if the system is functioning correctly, changes in input should result in predictable changes in output. * Metamorphic testing works by transforming source test cases into follow-up test cases * Here, thesource test caseinvolves testing themedium-speed vehicle'stravel time. * Thefollow-up test casesare derived byextrapolating travel times for fast and slow vehiclesusing predictable relationships based on speed differences. * MR states that modifying input should result in a predictable change in output * Since the speed of the vehicle is a known factor, it is possible to predict the new arrival times and verify whether they follow expected trends. * This is a direct application of metamorphic testing principles * Inroute optimization systems, metamorphic testing often applies transformations tospeed, distance, or conditionsto verify expected outcomes. * (B) Decomposing each route into traffic density and vehicle power# * While useful for statistical analysis, this approach does not generate follow-up test cases based on a definedmetamorphic relation (MR). * (C) Selecting dissimilar routes and transforming them into a fast or slow route# * Thisdoes not follow metamorphic testing principles, which require predictable transformations. * (D) Running fast vehicles on long routes and slow vehicles on short routes# * This methoddoes not maintain a controlled MRand introduces too manyuncontrolled variables. * Metamorphic testing generates follow-up test cases based on a source test case."MT is a technique aimed at generating test cases which are based on a source test case that has passed.One or more follow- up test cases are generated by changing (metamorphizing) the source test case based on a metamorphic relation (MR)." * MT has been used for testing route optimization AI systems."In the area of AI, MT has been used for testing image recognition, search engines, route optimization and voice recognition, among others." Why Option A is Correct?Why Other Options are Incorrect?References from ISTQB Certified Tester AI Testing Study GuideThus,option A is the correct answer, as it aligns with the principles ofmetamorphic testing by modifying input speeds and verifying expected results.
Question 129
Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase? SELECT ONE OPTION
Correct Answer: A
The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option: * Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics. * Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected. * Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained. * Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real- time applications. References: * ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.
Question 130
Which of the following characteristics of AI-based systems make it more difficult to ensure they are safe?
Correct Answer: C
The syllabus states that non-determinism is one of the key challenges for ensuring safety in AI- based systems: "The characteristics of AI-based systems that make it more difficult to ensure they are safe... include: complexity, non-determinism, probabilistic nature, self-learning, lack of transparency, interpretability and explainability, and lack of robustness."
Newest CT-AI Exam PDF Dumps shared by BraindumpsPass.com for Helping Passing CT-AI Exam! BraindumpsPass.com now offer the updated CT-AI exam dumps, the BraindumpsPass.com CT-AI exam questions have been updated and answers have been corrected get the latest BraindumpsPass.com CT-AI pdf dumps with Exam Engine here: