Introducing GeneBench-Pro

Openai··Submitted by Mads Kristian Nylund
Open Source AIAI Ethicsevaluation

GeneBench-Pro is a research-level benchmark that evaluates AI agents' ability to make complex, judgment-based decisions in computational biology, focusing on real-world challenges like ambiguity and data analysis. It includes 129 problems across 10 domains and 21 sub-domains, with a focus on system-level reasoning and decision-making. The benchmark assesses progress in overcoming computational biology's challenges, with frontier models like GPT-5.6 Sol achieving a pass rate of 28.7%, highlighting the difficulty of the tasks and the potential for partial automation.

Read Article

More from Openai

Related Articles