Testing with GenAI Course

Put your knowledge to the test with a final set of questions aligned with the course learning objectives. A score of 65% or higher is required to pass and receive a Certificate of Completion.

Please note that the official ISTQB® Certified Tester Specialist Level Testing with Generative AI (CT-GenAI) Exam is not included in the price and must be purchased separately.

The ISTQB® Certified Tester Specialist Level Testing with Generative AI (CT-GenAI) Syllabus includes 5 chapters:

1.1 Generative AI Foundations and Key Concepts

• AI Spectrum: Symbolic AI, Classical Machine Learning, Deep Learning, and Generative AI
• Basics of Generative AI and LLMs
• Foundation, Instruction-Tuned, and Reasoning LLMs
• Multimodal LLMs and Vision-Language Models

1.2 Leveraging Generative AI in Software Testing: Core Principles

• Key LLM Capabilities for Test Tasks
• AI Chatbots and LLM-Powered Testing Applications

2.1 Effective Prompt Development

• Structure of Prompts for Generative AI in Software Testing
• Core Prompting Techniques for Software Testing
• System Prompt and User Prompt

2.2 Applying Prompt Engineering Techniques to Software Test Tasks

• Test Analysis with Generative AI
• Test Design and Test Implementation with Generative AI
• Automated Regression Testing with Generative AI
• Test Monitoring and Test Control with Generative AI
• Choosing Prompting Techniques for Software Testing

2.3 Evaluate Generative AI Results and Refine Prompts for Software Test Tasks

• Metrics for Evaluating the Results of Generative AI on Test Tasks
• Techniques for Evaluating and Iteratively Refining Prompts

3.1 Hallucinations, Reasoning Errors and Biases

• Hallucinations, Reasoning Errors and Biases in Generative AI
• Identifying Hallucinations, Reasoning Errors and Biases in LLM Output
• Mitigation Techniques of GenAI Hallucinations, Reasoning Errors and Biases in Software Test Tasks
• Mitigation of Non-Deterministic Behaviour of LLMs

3.2 Data Privacy and Security Risks of Generative AI in Software Testing

• Data Privacy and Security Risks Associated with Using Generative AI
• Data Privacy and Vulnerabilities in Generative AI for Test Processes and Tools
• Mitigation Strategies to Protect Data Privacy and Enhance Security in Testing with Generative AI

3.3 Energy Consumption and Environmental Impact of Generative AI in Software Testing

• The Impact of Using GenAI on Energy Consumption and CO2 Emissions

3.4 AI Regulations, Standards, and Best Practice Frameworks

• AI Regulations, Standards and Frameworks Relevant to GenAI in Software Testing

4.1 Architectural Approaches for LLM-Powered Test Infrastructure

• Key Architectural Components and Concepts of LLM-Powered Test Infrastructure
• Retrieval-Augmented Generation
• The Role of LLM-Powered Agents in Automating Test Processes

4.2 Fine-Tuning and LLMOps: Operationalising Generative AI for Software Testing

• Fine-Tuning LLMs for Test Tasks
• LLMOps when Deploying and Managing LLMs for Software Testing

5.1 Roadmap for the Adoption of Generative AI in Software Testing

• Risks of Shadow AI
• Key Aspects of a Generative AI Strategy in Software Testing
• Selecting LLMs/SLMs for Software Test Tasks
• Phases when Adopting Generative AI in Software Testing

5.2 Manage Change when Adopting Generative AI for Software Testing

• Essential Skills and Knowledge for Testing with Generative AI
• Building Generative AI Capabilities in Test Teams
• Evolving Test Processes in AI-Enabled Test Organisations

By the end of the course, you will be able to:

• Explain the foundations, capabilities and limitations of generative AI and large language models
• Distinguish between foundation, instruction-tuned, reasoning and multimodal models
• Create well-structured prompts and select appropriate prompting techniques for different software testing tasks
• Apply GenAI to test analysis, test design, test implementation, regression testing, monitoring and reporting
• Evaluate GenAI-generated results and iteratively refine prompts to improve their quality
• Identify hallucinations, reasoning errors, bias and non-deterministic behaviour in LLM outputs
• Recognise data privacy, security and environmental risks and apply suitable mitigation measures
• Understand the regulations, standards and best-practice frameworks relevant to using GenAI in software testing
• Explain how RAG, LLM-powered agents, fine-tuning and LLMOps support AI-enabled test infrastructures
• Compare LLMs and smaller language models based on suitability, risks and recurring costs
• Contribute to a structured GenAI adoption strategy and implementation roadmap
• Understand how GenAI adoption changes testing roles, skills, processes and responsibilities

The course is fully aligned with ISTQB® Certified Tester – Testing with Generative AI (CT-GenAI) syllabus, helping learners  understand and apply GenAI techniques to realistic software testing scenarios.

This course is CPD accredited (View Exactpro’s certificate). Established in 1996, The CPD Certification Service is the largest and leading independent CPD accreditation organisation working across all industry sectors. www.cpuk.co.uk

Exactpro is an award-winning provider of AI-enabled software testing and development services for mission-critical technology of the global financial markets.

Exactpro team has successfully tested and released into live service such complex financial systems as trading, clearing and settlement platforms, market data, collateral and risk management systems, as well as regulatory reporting systems. We are happy to share years of experience with you on this course.

Our specialists regularly conduct global educational events. Learn more about Exactpro at exactpro.com.

Our goal is to provide you with the information and tools you need to make your study journey successful.

Follow the official CT-GenAI Syllabus as a starting point.

Explore Exactpo’s open Gen-AI materials library.

Enrol in our study portal to access slides, videos and quizzes.

Practice for 15 mins a day on our Practice hub to reinforce your knowledge in an interactive way.

Join Exactpro’s Software Testing Hub on LinkedIn and Facebook to get testing tips, industry insights, polls, videos and GenAI discussions, all at no charge.