Testing with GenAI

At the end of the course, you will have the opportunity to take the Mock Exam to check your knowledge. The mock exam bundle contains 5 full mock exam packs with a total of 200 questions, each with detailed explanations and answer guidance. The exams are written by software testing experts and fully aligned with the ISTQB® CT-GenAI certification format.

Please mind that the official ISTQB® Certified Tester Specialist Level Testing with Generative AI (CT-GenAI) Exam is not included in the price.

The ISTQB® Certified Tester Specialist Level Testing with Generative AI (CT-GenAI) Syllabus covers 5 chapters of the certification syllabus:

1.1 Generative AI Foundations and Key Concepts

• AI Spectrum: Symbolic AI, Classical Machine Learning, Deep Learning, and Generative AI
• Basics of Generative AI and LLMs
• Foundation, Instruction-Tuned, and Reasoning LLMs
• Multimodal LLMs and Vision-Language Models

1.2 Leveraging Generative AI in Software Testing: Core Principles

• Key LLM Capabilities for Test Tasks
• AI Chatbots and LLM-Powered Testing Applications

2.1 Effective Prompt Development

• Structure of Prompts for Generative AI in Software Testing
• Core Prompting Techniques for Software Testing
• System Prompt and User Prompt

2.2 Applying Prompt Engineering Techniques to Software Test Tasks

• Test Analysis with Generative AI
• Test Design and Test Implementation with Generative AI
• Automated Regression Testing with Generative AI
• Test Monitoring and Test Control with Generative AI
• Choosing Prompting Techniques for Software Testing

2.3 Evaluate Generative AI Results and Refine Prompts for Software Test Tasks

• Metrics for Evaluating the Results of Generative AI on Test Tasks
• Techniques for Evaluating and Iteratively Refining Prompts

3.1 Hallucinations, Reasoning Errors and Biases

• Hallucinations, Reasoning Errors and Biases in Generative AI
• Identifying Hallucinations, Reasoning Errors and Biases in LLM Output
• Mitigation Techniques of GenAI Hallucinations, Reasoning Errors and Biases in Software Test Tasks
• Mitigation of Non-Deterministic Behaviour of LLMs

3.2 Data Privacy and Security Risks of Generative AI in Software Testing

• Data Privacy and Security Risks Associated with Using Generative AI
• Data Privacy and Vulnerabilities in Generative AI for Test Processes and Tools
• Mitigation Strategies to Protect Data Privacy and Enhance Security in Testing with Generative AI

3.3 Energy Consumption and Environmental Impact of Generative AI in Software Testing

• The Impact of Using GenAI on Energy Consumption and CO2 Emissions

3.4 AI Regulations, Standards, and Best Practice Frameworks

• AI Regulations, Standards and Frameworks Relevant to GenAI in Software Testing

4.1 Architectural Approaches for LLM-Powered Test Infrastructure

• Key Architectural Components and Concepts of LLM-Powered Test Infrastructure
• Retrieval-Augmented Generation
• The Role of LLM-Powered Agents in Automating Test Processes

4.2 Fine-Tuning and LLMOps: Operationalising Generative AI for Software Testing

• Fine-Tuning LLMs for Test Tasks
• LLMOps when Deploying and Managing LLMs for Software Testing

5.1 Roadmap for the Adoption of Generative AI in Software Testing

• Risks of Shadow AI
• Key Aspects of a Generative AI Strategy in Software Testing
• Selecting LLMs/SLMs for Software Test Tasks
• Phases when Adopting Generative AI in Software Testing

5.2 Manage Change when Adopting Generative AI for Software Testing

• Essential Skills and Knowledge for Testing with Generative AI
• Building Generative AI Capabilities in Test Teams
• Evolving Test Processes in AI-Enabled Test Organisations

You can get the Course certificate after successfully completing the Mock Exam (with the pass mark of 65%) which you can place on Linkedin. Please note that this is not an official ISTQB® Certified Tester Specialist Level Testing with Generative AI (CT-GenAI) certificate.

Exactpro is an award-winning provider of AI-enabled software testing and development services for mission-critical technology of the global financial markets.

Exactpro team has successfully tested and released into live service such complex financial systems as trading, clearing and settlement platforms, market data, collateral and risk management systems, as well as regulatory reporting systems. We are happy to share years of experience with you on this course.

Our specialists regularly conduct global educational events. Learn more about Exactpro at exactpro.com.

We recommend following the official CT-GenAI – Syllabus.

You can join the Software Testing Hub on LinkedIn and Facebook for testing tips, industry insights, polls, videos and GenAI discussions with no charges and no subscription required.