* Post generated using GeminiAI
As the race toward frontier AI models accelerates, the need for rigorous, independent evaluation has never been more critical. At the centre of this technical challenge in the UK sits the Artificial Intelligence Safety Institute (AISI), and steering its technical strategy is Chief Technology Officer, Jade Leung.
The role of CTO at a national safety institute is unique. It isn’t about building a commercial product; it is about building the rigorous scientific infrastructure needed to understand and mitigate the risks of superintelligent systems.
Jade Leung brings a vital dual perspective to this immense challenge. With a background spanning engineering, research at Oxford’s Future of Humanity Institute, and a prominent role leading governance research at OpenAI, she understands both the raw mechanics of LLMs and the complex sociotechnical systems they inhabit.
As CTO of the AISI, Jade’s mandate is formidable. Her key responsibilities revolve around three critical pillars:
1. Designing the “Crash Tests” for Frontier AI Jade leads the teams responsible for developing technical evaluations (“evals”) for the world’s most advanced models. This involves creating complex methodologies to stress-test models for catastrophic risks—including cybersecurity vulnerabilities, chemical and biological misuse potential, and autonomous capabilities. Her teams are essentially trying to “break” these models in a controlled environment before they are widely deployed.
2. Building Secure Research Infrastructure Testing frontier models requires immense compute power and highly secure environments. Jade oversees the engineering effort to build and maintain the technical infrastructure that allows the AISI to handle sensitive model weights and conduct large-scale experiments securely, independent of private labs.
3. Bridging the Technical-Policy Divide Perhaps most importantly, Jade’s background allows her to translate dense technical findings into actionable insights for the government. She ensures that regulatory decisions are grounded in empirical engineering reality, not just theory.
Under Jade Leung’s technical leadership, the AISI is moving beyond high-level discussions of safety and into the realm of concrete, engineering-led evaluation. It is pioneering work that is defining how nations interact with advanced artificial intelligence.
#AI #AISafety #TechLeadership #UKGovernment #FrontierAI #Engineering
A decent biographical post about Jade Leung;
https://uk20.substack.com/p/a-short-biography-of-the-prime-ministers
I do wonder whether her history with OpenAI will make her biased towards that particular company?
This involves creating complex methodologies to stress-test models for catastrophic risks—yup
Testing frontier models requires immense compute power and highly secure environments-nope. Regulatory decisions are grounded in empirical engineering reality, not just theory, -one would hope.
Alternatively, one man, his cute dog and three A.I’s can craft a viable, safe, cheap, secure protocol that makes legacy infrastructure safe and resists LLM drift in adversarial scenarios, that is currently running, tested in the wild (live world environment) and not theory but functional and more importantly, British.