About the Book
This book offers a comprehensive introduction to artificial intelligence and machine learning fundamentals, equipping software testers with the skills to effectively leverage AI-powered solutions for testing complex systems and AI applications. It also fully prepares readers for the ISTQB® Certified Tester AI Testing (CT-AI) certification exam.
Written in a practical and accessible style, this book offers a structured approach to AI testing based on the ISTQB® CT-AI syllabus. It includes practical examples, detailed explanations, industry insights, a mock exam and chapter-based questions to help readers succeed in the ISTQB® CT-AI exam.
This book is designed for newcomers and seasoned practitioners involved in testing AI-based systems as well as those seeking a deeper understanding of AI systems in general. It offers valuable insights into implementing AI-enabled solutions and enhancing the quality of AI-driven software, making it an indispensable resource.
ISTQB® is a registered trademark of the International Software Testing Qualifications Board.
Table of Contents:
Chapter 1: Introduction to AI
Chapter 2: Quality Characteristics for AI-based Systems
Chapter 3: Machine Learning Overview
Chapter 4 Machine Learning Data
Chapter 5: Machine Learning Functional Performance Metrics
Chapter 6: Machine Learning Neural Networks and Testing
Chapter 7: Testing AI-based Systems Overview
Chapter 8: Testing AI-specific Quality Characteristics
Chapter 9: Methods and Techniques
Chapter 10: Test Environments for AI-based Systems
Chapter 11: Using AI for Testing
About the Author :
This book was co-authored by a cross-functional team of Exactpro colleagues. It is an educational effort grounded, in equal parts, in Exactpro’s ISTQB®-accredited AI Testing training course and the diversity of the authors’ skillsets that spans academic backgrounds, industry research and practice, economics, creative and visual thinking, marketing and linguistics.
Review :
This book, with the ISTQB® CT-AI syllabus as a backbone, does more than simply prepare readers for certification. It enhances and enriches its content with numerous theoretical and practical examples, rigorously contextualizing the principles while making them accessible to IT quality professionals, and anyone interested in analyzing and understanding this new social phenomenon. It is a solid reference and a valuable resource, not only for passing the certification, but also far beyond, for testing AI or testing with AI. Without a doubt, an essential bedside book for the new generation of QA-ers, and for the older ones that want to keep abreast with progress.
Olivier Denoo, Vice President of the ISTQB, President of CFTL, Vice President of ps_testware SAS
It’s clear this book was written by professionals with real-world experience testing complex systems in high-stakes industries. The thoughtful focus on structure, performance, compliance, and resilience reflects the kind of rigor required in heavy regulated domain like for example financial services, where reliability and regulatory alignment are non-negotiable. For anyone working with AI systems, this book offers both practical tools and valuable perspective.
Sophie Lafont, Consultant in Software Regulatory Compliance, Financial Services Industry
The AI and testing concepts are explained beyond their dictionary meaning. Useful questions and hands-on examples review the topics in each chapter. That’s ideal for beginners and will give practitioners a path for their transition to AI. The real world examples help improve understanding for project professionals and less technical managers.
Carol Long CEng FBCS FRSA, Consultant and past chair of BCS Quality SIG
A clear, practical guide that demystifies AI testing and supports ISTQB certification preparation. Introduction to AI Testing is a valuable companion for professionals building confidence and competence in the field.
Joris Schut AIGP RAI CT-AI, Advisor, BearingPoint
Introduction to AI Testing offers a comprehensive and structured foundation in AI system validation—covering everything from ML fundamentals and neural networks to AI-specific quality metrics, testing techniques, and test environments. An essential read for AI practitioners and testers. Highly recommend it!
Kapil Kumar Sharma FBCS, Data Architect, Cisco Systems Inc.
From the ISTQB® CT-AI exam training perspective, this is one of the most usable resources I’ve come across. It’s well-organised, clear, and filled with pictures, graphs and charts that support deeper comprehension. I wouldn’t hesitate
Natia Sirbiladze, Co-Founder and President of GeoSTQB, Board Member of ICTA, and CEO of Exactpro Georgia
This book strikes a pragmatic balance between technical accuracy, topic coverage, and accessibility. The authors skilfully introduce readers to both contemporary AI and its intricate relationship with testing—exploring not only how AI systems can be tested but also how AI can enhance testing practices. Given the complexity of the subject matter, the authors deserve commendation for delivering such a clear and structured introduction.
Daniele Gianni, Service and Project Manager, EU Agency
Far more than an introduction, Introduction to AI Testing uses its unique ‘theory to practice’ sections to make complex AI and testing concepts readily understandable. An invaluable resource that lowers the learning curve for any professional.
David Bower CEng, Solutions Architect
With the rapid emergence, development and implementation of AI systems, Introduction to AI Testing couldn't be more timely! This book clearly and engagingly describes the context and detail of both AI and machine learning, before moving to describe the required practices to test such systems and govern quality assurance. Whether the reader is new to AI, testing or both - this serves as an excellent resource.
John Burns MSc LL.M CEng MBCS, Information Security Risk Analyst
With its methodical approach to AI testing, this book fills a critical gap for engineering leaders navigating AI risk. It equips quality teams to embed accountability, interoperability and trust into intelligent systems.
Sri Kolagani, Senior Engineering Manager, Elastic
In the rapidly evolving era of artificial intelligence, this book stands out as an essential resource for professionals seeking to understand and apply AI testing principles within a structured, industry-recognized framework. It goes beyond the scope of testing alone, offering clear explanations of core Machine Learning and AI concepts and demonstrating how these systems can be effectively tested. A valuable guide for navigating the unique challenges of testing intelligent systems.
Renjith Ramachandran, Senior Solutions Architect, BJs Wholesale Club
