Date: 24 October 2024
Location: Online
Using artificial intelligence (AI) in software testing has become essential for streamlining processes, enhancing efficiency, and enabling organisations to deliver high-quality software products more efficiently. Our webinar series titled ‘AI Testing Talks’ features discussions on AI-related topics exploring various aspects of software testing and AI technology including Generative AI, AI-powered test tools, the impact of AI biases, the role of AI in software testing, and more. The sessions provide you with the opportunity to stay updated on recent tech trends and discover strategies to improve your current projects with a cutting-edge technology stack.
AI Testing Talks participants are encouraged to engage in the Q&A session, ask questions, and share their thoughts.
On 24 October, we held the next session of our ‘AI Testing Talks’ webinar featuring invited speaker Song Wang, Associate Professor at York University.
Demystifying and Detecting Bugs in AI Infrastructure Software
AI infrastructure software, such as TensorFlow and PyTorch, is essential for powering modern machine learning applications. However, the complexity and scale of these frameworks present significant challenges in ensuring their reliability and security. In his presentation, Song discussed recent efforts in characterising, identifying, and mitigating bugs and vulnerabilities within AI infrastructure software. The presentation started by exploring the characteristics of vulnerabilities in these systems. Next, Song highlighted the gaps between current state-of-the-art bug and vulnerability detection methods, such as static analysis and dynamic fuzzing tools, and their effectiveness in detecting AI infrastructure vulnerabilities. Song also introduced the data-driven fuzzing approach for uncovering bugs and vulnerabilities in AI infrastructure software. Additionally, Song discussed their pilot studies on hunting AI infrastructure software bugs in the context of large language models (LLMs).
Invited Speaker
Song Wang
Associate Professor at York University
Bio
Song earned his Ph.D. from the University of Waterloo in January 2019 and then joined York University as an Assistant Professor. He received tenure and was promoted to Associate Professor in 2024. He serves as an Associate Editor for ACM Transactions on Software Engineering and Methodology (TOSEM). His research lies at the intersection of Software Engineering and Artificial Intelligence, with a focus on improving the reliability of AI infrastructure software by characterising, identifying, and mitigating vulnerabilities, bugs, and failures in frameworks such as TensorFlow and PyTorch. To date, he has published over 80 papers in prestigious Software Engineering journals and flagship conferences. His work has received four best paper awards, including a Distinguished Paper Award at APSEC’23, an ACM Distinguished Paper Award at ICPC’22, another at ICSE’20, and a Best Paper Award at PROMISE’19. Additionally, he was recognized as one of the top 10 most impactful early-career researchers in Software Engineering by the Journal of Systems and Software.
AI Testing Talks Moderator
Anna-Maria Lukina
Marketing Director, Exactpro
Bio
Anna-Maria Lukina is a Marketing Director at Exactpro responsible for global brand and business development, management of industry events and professional development initiatives. With a deep understanding of information systems and technologies and extensive experience in global marketing, Anna-Maria has successfully led the Exactpro brand through product launches, the acquisition by LSEG and the following buyout, countless international and local industry gatherings, as well as the accompanying social media campaigns.
Anna-Maria has been spearheading Exactpro’s award-winning AI Testing course as Outreach Director.
Q&A Session Expert
Iosif Itkin
CEO and co-founder of Exactpro
Bio
Iosif Itkin is a co-founder & co-CEO of Exactpro, an independent provider of software testing services for financial sector organisations. Founded in 2009, Exactpro employs over 450 specialists. Among other things Iosif is responsible for the AI Testing strategy and trading systems reliability research. He holds a MSc degree in Theoretical Physics.
In his professional career, Iosif has held many technology roles: software developer, performance testing department lead, technology architect, VP of technology – on a number of global financial industry initiatives. Iosif’s expertise at the intersection of high-availability systems and capital markets has enabled him to successfully facilitate technology transformations within exchanges, investment banks and clearing and settlement organisations in London, New York, Milan, Singapore, Sydney and other major financial centres.
About Exactpro
Exactpro is an independent provider of AI-enabled software testing services for financial sector organisations. Our clients are exchanges, post-trade platform operators, and banks across 20 countries. Our area of expertise comprises protocol-based testing of matching engines, market data, market surveillance, clearing and settlement systems, payments APIs. We help our clients to decrease time to market, maintain regulatory compliance, improve scalability, latency and operational resiliency. Exactpro is involved in a variety of transformation programmes related to large-scale cloud and DLT implementations at systemically important organisations.
Our approaches leverage artificial intelligence (AI) to help harness the power of exploratory data analysis and big data analytics to assist in the generation of test ideas and the interpretation of test results, supported by advanced execution capabilities of the th2 frameworks suite.
Founded in 2009, the Exactpro Group is headquartered in the UK and operates delivery centres in Georgia, Sri Lanka, Armenia, Lithuania and the UK and representative offices in the US, Canada, Italy and Australia.