Testing AI systems – Why didn’t anybody else think of it?

What started as a desire to research testing of AI systems led to building a unique product for improving the quality of AI systems. The experience of delivering AI systems in areas ranging from agritech to med tech exposed us to the lack of techniques, tools and procedures for testing AI. It made us aware of the challenges of testing AI systems namely

• Non-deterministic nature of AI systems
• Lack of test oracles
• Confusion about role of developers and testers
• Absence of suitable techniques and tools
• Doubts about trustworthiness of AI

This talk is about presenting a bird’s-eye view of testing challenges of AI systems and how to overcome them.  Key techniques that we cover and demonstrate are metamorphic testing, explainability, testing for adversarial robustness and coverage measures for neural networks. These are demonstrated using a unique, one-of-its-kind, made-in-India, research driven product named AIEnsured.

An Ex-Adobe engineer and IIT alumnus with a 25-year experience in Software Development and Testing industry. Mentor, entrepreneur (Founder of Verity Software and SALT) and leader (President of the Indian Testing – ISTQB Board), Convenor of STeP-IN forum, National Convenor of Indica Academy. Amongst the first testers of India, starting testing career in 1995.

Inventor of Q-Patterns and the Linguistic Analysis technique for test design and reuse.

A thought leader – Best paper award winner at various conferences and invited keynote speaker world over, Author and creator of Mobile Applications Certification (CMAP), Chair of Mobile Application Tester certification from ISTQB, creator of AiU – world first AI testing certification, DoU – DevOps united, world’s first DevOps and testing certification and many others.

He loves to engage himself in a variety of fields ranging from Archaeology and culture, education to technology.

He is a Ph.D. in Artificial Intelligence from University of Alberta, Edmonton, Canada

Awarded the title of “Eminent Engineer” by the renowned organization “Institution of Engineers” (IEI). Excellence award for Innovation at Infosys, Research excellence award at the University of Alberta, and Merit award at IIT Kanpur.

Ex-president of ACM India, the top professional organization of computing professionals, he is currently the chief Mentor for Tarah technologies, an AI consulting company through which he does marquee training and strategic consulting work in AI.

Co-founder of CityMandi.com a next generation AI enabled mart B2B startup in Food Tech, he is also a Governance Board member of Totalstart.

He is a guest professor at IIT Tirupati. He specializes in areas of software engineering,AI and Machine Learning.

He likes Browsing, Reading Indian Mythology, Debating.