People
People in evaluation and benchmarks
93 people in the USASI People directory whose profiles list evaluation and benchmarks as a field of their work. Listed alphabetically; this is not a ranking. Each profile covers public professional work only, cited to official pages.
Adina Williams
Research Scientist, Meta
Research scientist at Meta's FAIR; first author of the MultiNLI corpus and co-author of Llama 2
AI Explained
Creator, AI Explained
YouTube channel, podcast, and newsletter covering the arrival of smarter-than-human AI
Ajeya Cotra
Technical Staff, METR
METR technical staff working on threat modeling and risk assessment; lead of METR's 2026 Frontier Risk Report
Akshita Bhagia
Senior Research Engineer, AllenNLP team, Ai2
Senior Research Engineer at Ai2 working on the OLMo and FlexOlmo open language models
Andrew Laack
Product engineer, Imbue
Product engineer at Imbue and creator of Vet, an open-source code review tool for agent-written code
Andy Konwinski
Co-founder, MoTS, Board; Laude Ventures Co-founder and GP, Laude Institute and Laude Ventures
Co-founder of Laude, Databricks and Perplexity; co-author of the Terminal-Bench and Mesos papers
Anton Troynikov
Co-founder, Chroma
Co-founder of Chroma; co-author of Chroma technical reports on retrieval and context
Aylin Caliskan
Associate Professor, The Information School; Paul G. Allen School of Computer Science & Engineering (courtesy), University of Washington
University of Washington associate professor studying bias, safety, and societal impacts of AI
Beth Barnes
Founder and CEO, METR
Founder and CEO of METR, a research nonprofit that evaluates the autonomous capabilities of frontier AI models
Collin Burns
Worked at OpenAI, OpenAI
AI researcher formerly at OpenAI and Anthropic; first author of weak-to-strong generalization research
Dan Hendrycks
Executive & Research Director, Center for AI Safety
Executive and Research Director of the Center for AI Safety; co-author of MMLU and Humanity's Last Exam
Daniel Bourke
Member of Technical Staff, Artificial Analysis
Machine learning teacher and YouTube creator; Member of Technical Staff at Artificial Analysis
David Kanter
Founder, board member and Head of MLPerf, MLCommons
Founder, board member and Head of MLPerf at MLCommons; co-author of the MLPerf benchmark papers
David Patterson
Google Fellow, Google
Google Fellow and UC Berkeley professor emeritus; co-author of Google TPU papers and MLPerf Training
David Stutz
Research scientist, Google DeepMind
Research scientist at DeepMind; first author of the SynthID Bio protein watermarking paper
Denis Yarats
Co-founder and CTO, Perplexity
Co-founder and CTO of Perplexity; first author of DrQ-v2 for reinforcement learning from pixels
Diogo Almeida
Founder and CEO, TypeSafe AI
Founder and CEO of TypeSafe AI; co-author of OpenAI's InstructGPT paper on training with human feedback
Douwe Kiela
Researcher, Google DeepMind
Researcher at Google DeepMind; co-founder and former CEO of Contextual AI; co-author of the RAG paper
Emmanuel Dupoux
Professor (EHESS), Cognitive machine learning team, EHESS
EHESS professor in the Cognitive Machine Learning team; co-author of FAIR's generative spoken language work
Eric Horvitz
Chief Scientific Officer, Microsoft
Chief Scientific Officer of Microsoft and former director of Microsoft Research
Eric Michael Smith
Research Scientist (the page's bio describes a Research Engineer role at FAIR), Meta
Research scientist at Meta; first author of HolisticBias and a core contributor to Llama 3
Ethan Perez
Researcher, Anthropic
Anthropic safety researcher; co-author of the RAG, red-teaming, and Constitutional Classifiers work
Eugene Yan
Member of Technical Staff, Anthropic
Member of Technical Staff at Anthropic; former Principal Applied Scientist at Amazon
François Chollet
Co-founder, ARC Prize Foundation
Creator and project lead of Keras, whose KerasHub runs open-weight models on JAX, PyTorch, or TensorFlow
Gabe Pereyra
President and co-founder, Harvey
President and co-founder of Harvey; co-author of the post introducing Harvey's Legal Agent Benchmark
Greg Kamradt
President and board member, ARC Prize Foundation
President and board member of the ARC Prize Foundation; author of the ARC-AGI-2 and ARC-AGI-3 launch posts
Hamel Husain
ML engineer and independent consultant, Parlance Labs
ML engineer and consultant at Parlance Labs; earlier applied ML at GitHub and first author of CodeSearchNet
Harold Booth
Computer Scientist, Software Security Group, National Institute of Standards and Technology
NIST computer scientist in the Software Security Group; co-author of the Dioptra AI test platform
Hjalmar Wijk
Chief Scientist, METR
Chief Scientist at METR, working on threat modeling; first author of the RE-Bench AI R&D evaluation
Ian R. McKenzie
Research Engineer (since September 2025), Google DeepMind
Google DeepMind research engineer; lead author of the Inverse Scaling paper and FAR.AI's STACK study
Ion Stoica
Professor of Computer Science, Xu Bao Chancellor Chair; Director of the Sky Computing Lab, University of California, Berkeley
Co-author of the Ray and vLLM papers; UC Berkeley professor and co-founder of Databricks and Anyscale
Jack Clark
Co-Founder and Head of Public Benefit, Anthropic
Anthropic co-founder and Head of Public Benefit; writes the Import AI newsletter
Jacob Steinhardt
Associate Professor of Statistics and EECS, University of California, Berkeley
UC Berkeley associate professor of Statistics and EECS; founder and CEO of the nonprofit lab Transluce
Jaime Sevilla
Co-founder and Chief Executive Officer (director and co-founder since 2022), Epoch AI
Co-founder and CEO of Epoch AI; first author of "Compute Trends Across Three Eras of Machine Learning"
James Glasbrenner
Principal AI Engineer, The MITRE Corporation
MITRE Principal AI Engineer; first-listed author of NIST's Dioptra AI test platform
Jascha Sohl-Dickstein
Member of Technical Staff, Anthropic
Member of Technical Staff at Anthropic; first author of the 2015 paper that introduced diffusion models
Jeff Huber
Founder, Chroma
Founder of Chroma, the open-source search and retrieval database for AI applications
Jesse Dodge
Research scientist, Meta Superintelligence Labs
Research scientist in Meta Superintelligence Labs; former OLMo evaluation lead at Ai2
Jiatong Shi
Organization listed on Shi's GitHub profile, Anuttacon
First author of the VERSA speech and audio evaluation toolkit; former PhD student in CMU's WAVLab
João Carreira
Research Scientist, Google DeepMind
Research scientist at Google DeepMind; co-creator of the Kinetics dataset and the Perception Test
Joelle Pineau
Chief AI Officer, Cohere
Chief AI Officer at Cohere and McGill professor; led Meta's FAIR research team from 2017 to 2025
John Yang
Computer Science PhD student, Stanford University
Stanford PhD student; creator of SWE-bench and SWE-agent and senior author of the SWE-sweep benchmark
Joseph E. Gonzalez
Associate Professor, Department of Electrical Engineering and Computer Sciences, University of California, Berkeley
UC Berkeley professor whose group built Gorilla and the Berkeley Function Calling Leaderboard
Joy Buolamwini
Founder and President, Algorithmic Justice League
Founder and President of the Algorithmic Justice League; author of Unmasking AI and a newsletter
Kai Fronsdal
Research Engineer (joined 2026), Meridian Labs
Research engineer at Meridian Labs and lead author of Petri, the open-source alignment auditing tool
Karen Livescu
Professor, Toyota Technological Institute at Chicago
Professor at TTI-Chicago working on speech and language processing; former MIT EECS post-doctoral lecturer
Kate Soule
Director, Technical Product Management, Granite, IBM Research
Director of Technical Product Management for Granite at IBM Research; co-author of Granite Embedding
Kilian Lieret
AI Research Scientist, Meta Superintelligence Labs (joined February 2026), Meta
AI research scientist at Meta Superintelligence Labs; lead author of the SWE-sweep bug-fixing benchmark
Kush R. Varshney
IBM Fellow, directing Human-Centered Trustworthy AI research, IBM Research
IBM Fellow directing trustworthy AI research at IBM; team behind AI Fairness 360 and Granite Guardian
Kyle Lo
Research scientist; co-lead of the OLMo project, Ai2
Former Ai2 research scientist who co-led the OLMo project; last-listed author of the Dolma paper
Leo Gao
Lead author of The Pile (2020), published with an EleutherAI affiliation, EleutherAI
First author of The Pile and first-listed author of EleutherAI's LM Evaluation Harness
Maarten Sap
Assistant Professor, Language Technologies Institute (courtesy appointment in HCII), Carnegie Mellon University
Carnegie Mellon assistant professor and part-time senior research scientist at Ai2; co-author of SOTOPIA
Margaret Mitchell
Researcher and Chief Ethics Scientist, Hugging Face
Researcher and Chief Ethics Scientist at Hugging Face; first author of Model Cards for Model Reporting
Marina Danilevsky
Senior Research Scientist, Manager - core language and conversational technologies, IBM Research
Senior Research Scientist and manager at IBM Research; co-author of the MTRAG multi-turn RAG benchmark
Marius Hobbhahn
CEO and Co-founder, Apollo Research
CEO and co-founder of Apollo Research, working on AI model evaluations; former Epoch research fellow
Mark Chen
Chief Research Officer, OpenAI
Chief Research Officer at OpenAI; first author of the Codex paper that released HumanEval
Michael Collins
Research scientist, Google
Natural language processing researcher and research scientist at Google; former MIT faculty member
Mike Knoop
Co-founder and board member, ARC Prize Foundation
Co-founder and board member of the ARC Prize Foundation; co-founder of Zapier and of the lab Ndea
Mohit Iyyer
Associate Professor, Computer Science, University of Maryland
University of Maryland associate professor; former Young Investigator at Ai2
Nanyun (Violet) Peng
Senior Staff Research Scientist, Google
Google Senior Staff Research Scientist and UCLA associate professor (on leave) working on creative NLP
Nate Rush
Chief Technology Officer, METR
CTO of METR; previously founder and CEO of the Python tooling company Mito
Nicholas Carlini
Research Scientist, Anthropic
Research scientist at Anthropic working on machine learning security; formerly at Google Brain and DeepMind
Niko Grupen
Head of Applied Research (joined early 2023), Harvey
Head of Applied Research at Harvey; lead byline on the Legal Agent Benchmark (LAB) announcement
Nils Reimers
VP of AI Search, Cohere
Creator of the Sentence Transformers library and VP of AI Search at Cohere
Noah A. Smith
Vice Provost for Artificial Intelligence; Charles and Lisa Simonyi Endowed Chair for Artificial Intelligence and Emerging Technologies; Professor, Paul G. Allen School of Computer Science & Engineering, University of Washington
UW Vice Provost for AI and professor; Senior Director of NLP Research at Ai2, directing OLMo
Owain Evans
Director, Truthful AI
Director of the nonprofit Truthful AI and affiliate researcher at CHAI, UC Berkeley; TruthfulQA co-author
Percy Liang
Professor of Computer Science (and courtesy in Statistics); Director, Center for Research on Foundation Models, Stanford University
Stanford professor and director of CRFM; creator of Marin, first author of HELM, Together AI founder
Peter Mattson
Founder, President and board member, MLCommons
Founder and President of MLCommons and founding General Chair of MLPerf; senior staff engineer at Google
Pradeep Dasigi
Lead Research Scientist, Olmo team, Allen Institute for AI
Lead Research Scientist on the Olmo team at Ai2; credited with technical leadership on Olmo 3
Richard Zhang
Principal Scientist, Adobe Research
Principal Scientist at Adobe Research; first author of the LPIPS perceptual metric and image colorization work
Rishi Bommasani
Senior Research Scholar, Stanford Institute for Human-Centered Artificial Intelligence (HAI), Stanford University
Senior Research Scholar at Stanford HAI; HELM co-author and first author of the foundation models report
Rohan Taori
Researcher on the pretraining team, Anthropic
Pretraining researcher at Anthropic; co-author of Stanford Alpaca, AlpacaFarm and AlpacaEval
Ruchir Puri
Chief Scientist, IBM Research; IBM Fellow; Vice President, IBM Technology & Technical Community, IBM Research
Chief Scientist of IBM Research and IBM Fellow; first author of the Project CodeNet dataset paper
Saadia Gabriel
Assistant Professor of Computer Science, UCLA Samueli School of Engineering, University of California, Los Angeles
UCLA assistant professor studying factuality, intent, and harm in language; former NYU and MIT fellow
Sameer Singh
Professor, Department of Computer Science, University of California, Irvine
UC Irvine professor of computer science; co-author of LIME and CheckList; former Ai2 Allen Fellow
Samuel R. Bowman
Technical AI safety researcher, Anthropic
Technical AI safety researcher at Anthropic; NYU associate professor on leave; co-author of Petri
Sasha Luccioni
Co-Founder and Chief Scientific Officer, Sustainable AI Group
AI and climate researcher; co-founder and Chief Scientific Officer of Sustainable AI Group
Shawn Lewis
Distinguished Engineer and Cofounder, Weights & Biases
Co-founder and Distinguished Engineer of Weights & Biases; first listed author of the W&B Weave package
Shinji Watanabe
Associate Professor, Carnegie Mellon University
Associate Professor at Carnegie Mellon University; first author of the ESPnet speech processing toolkit
Shreya Shankar
Visiting Assistant Professor, Computer Science Department (from July 2026); Assistant Professor from July 2027, Carnegie Mellon University
Computer science researcher who built DocETL at UC Berkeley; incoming Assistant Professor at Carnegie Mellon
Shunyu Yao
Researcher, OpenAI
First author of ReAct, Tree of Thoughts and the τ-bench agent benchmark; language-agent researcher
Stella Biderman
Executive Director, EleutherAI
Executive Director of EleutherAI; first author of the Pythia open model suite
Stephen Casper
Assistant Professor; Faculty Affiliate with the Harvard School of Engineering and Applied Sciences, Harvard University
Harvard Kennedy School assistant professor working on AI safeguards, incidents, and governance
Su Lin Blodgett
Independent visiting researcher, Mila
Researcher on the social implications and evaluation of NLP; formerly at Microsoft Research
Swabha Swayamdipta
Gabilan Assistant Professor, USC Viterbi Computer Science; Associate Director, USC Center for AI and Society, University of Southern California
USC Gabilan Assistant Professor and Amazon Scholar; first author of Dataset Cartography
Tatsunori Hashimoto
Assistant Professor, Computer Science Department, Stanford University
Stanford assistant professor; advisor on Stanford Alpaca, HELM co-author, and CS336 instructor
Terry Yue Zhuo
Research lead; founded the Qwen Cyber team, Alibaba Qwen
Lead author of the BigCodeBench code-generation benchmark; former research lead at Alibaba Qwen
Thomas Scialom
Listed with GenAI, Meta on 2023 papers and with Meta Superintelligence Labs on a 2025 paper and a February 2026 paper (Gaia2), Meta
Corresponding author of Meta's Llama 2 paper; a lead author of the ARE agent platform and Gaia2 benchmark
Timnit Gebru
Founder and Executive Director, Distributed AI Research Institute
Founder and executive director of DAIR; first author of Datasheets for Datasets
Valentina Pyatkin
Researcher working on LLM post-training for the Swiss AI Initiative, ETH AI Center
Researcher at the ETH AI Center working on LLM post-training; core contributor to Tülu 3
Yacine Jernite
Leads the ML and Society team, Hugging Face
Leads the ML and Society team at Hugging Face; co-author of the Transformers and StarCoder2 papers
Yoav Shoham
Chairman & Co-Founder, AI21 Labs
Co-founder and chairman of AI21 Labs; professor emeritus of computer science at Stanford
Yulia Tsvetkov
Associate Professor, Paul G. Allen School of Computer Science & Engineering, University of Washington
University of Washington associate professor working on reliable, socially aware, and multilingual NLP
Support Us
Help keep USASI useful.
Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).
About supporting this project