Singapore has put forward a new international standard (ISO/IEC AWI TS 42119-8) (“Testing Standard“) to standardise the testing methodology for Generative Artificial Intelligence (“GenAI“) systems, aimed at strengthening the foundation for trustworthy Artificial Intelligence (“AI“) testing. This is the first international standard of its kind for the testing of GenAI systems.
With the rapid development and pervasiveness of AI across ecosystems, it is crucial that there are globally recognised AI standards to ensure AI is used in a reliable and safe way. Specifically, Singapore has put forth the new Testing Standard with a focus on benchmarking and red teaming methodologies for GenAI systems with standardised testing approaches. Overall, it establishes an important framework for AI testing that enhances the reproducibility and comparability of results. This, in turn, will drive assurance and overall trust in AI systems and enable safer, more reliable adoption by AI deployers and users.
The Testing Standard builds on the Infocomm Media Development Authority’s (“IMDA’s“) past work in developing domestic testing frameworks, including the AI Verify Toolkit and the Starter Kit for Testing of LLM-Based Applications for Safety and Reliability and in the nascent field of assurance through the Global AI Assurance Sandbox. It is part of Singapore’s broader commitment to international AI standards, as seen in the national adoption and accreditation programme of ISO/IEC 42001 led by EnterpriseSG, and the contribution of real-world use cases to support ISO/IEC TR 24030’s documentation of AI applications in practice. Together, these efforts lay the groundwork for trustworthy AI implementation.
Click on the following link for more information:
- IMDA Press Release titled “Singapore Champions New Global AI Testing Standardisation Efforts on Benchmarking and Red Teaming” (available on the IMDA website at www.imda.gov.sg)
Disclaimer
Rajah & Tann Asia is a network of member firms with local legal practices in Cambodia, Indonesia, Lao PDR, Malaysia, Myanmar, the Philippines, Singapore, Thailand and Vietnam. Our Asian network also includes our regional office in China as well as regional desks focused on Brunei, Japan and South Asia. Member firms are independently constituted and regulated in accordance with relevant local requirements.
The contents of this publication are owned by Rajah & Tann Asia together with each of its member firms and are subject to all relevant protection (including but not limited to copyright protection) under the laws of each of the countries where the member firm operates and, through international treaties, other countries. No part of this publication may be reproduced, licensed, sold, published, transmitted, modified, adapted, publicly displayed, broadcast (including storage in any medium by electronic means whether or not transiently for any purpose save as permitted herein) without the prior written permission of Rajah & Tann Asia or its respective member firms.
Please note also that whilst the information in this publication is correct to the best of our knowledge and belief at the time of writing, it is only intended to provide a general guide to the subject matter and should not be treated as legal advice or a substitute for specific professional advice for any particular course of action as such information may not suit your specific business and operational requirements. You should seek legal advice for your specific situation. In addition, the information in this publication does not create any relationship, whether legally binding or otherwise. Rajah & Tann Asia and its member firms do not accept, and fully disclaim, responsibility for any loss or damage which may result from accessing or relying on the information in this publication.
