About the conference

The AI & Big Data Expo Global is a premier event held in London, spotlighting the latest advancements in artificial intelligence, big data, and their applications across diverse industries. Bringing together thought leaders, innovators, and decision-makers, the expo features keynote presentations, interactive panel discussions, and an extensive showcase of cutting-edge solutions. It’s an essential gathering for professionals eager to explore the transformative potential of AI and big data in areas such as healthcare, finance, retail, and beyond.

Link to the conference

Our talk

February 6th, 13.30 - 13.50 Custom Safety Evaluations for AI Systems and Agents

Standard safety benchmarks often struggle to keep pace with emerging risks and use cases, particularly as AI capabilities rapidly advance. While these benchmarks provide a foundation, companies often need to address their specific policies and unique safety requirements. Through real-world case studies, this talk explores how organizations develop custom evaluation datasets and implement effective red teaming programs – from testing multimodal systems to evaluating AI agent behaviors. We'll examine practical approaches to safety testing, highlighting the crucial role of human expertise in developing and implementing comprehensive evaluation frameworks.