Zico Kolter
Head of Carnegie Mellon's Machine Learning Department; chairs OpenAI's Safety and Security Committee
- Professor and Department Head, Machine Learning Department, Carnegie Mellon University12
- Member of the Board; chairs the Safety and Security Committee, OpenAI1
- Member of the Board, Qualcomm1
- Co-founder and Chief Scientist, Gray Swan AI1
Zico Kolter is a Professor and Department Head of the Machine Learning Department at Carnegie Mellon University. Kolter serves on the Board of OpenAI, where Kolter chairs the Safety and Security Committee, and on the Board of Qualcomm, and is a co-founder and Chief Scientist of Gray Swan AI, an AI security company. Kolter's group works on making deep learning more robust and safer and on understanding how data affects how models function. Kolter is a co-author of the 2023 paper "Universal and Transferable Adversarial Attacks on Aligned Language Models," which generates adversarial prompt suffixes automatically and releases its code.123
Work
Universal and Transferable Adversarial Attacks on Aligned Language Models (external site: arxiv.org)Published research
Co-author of the 2023 paper that finds adversarial suffixes through greedy and gradient-based search, causing aligned language models to produce objectionable content, and shows that the attacks transfer to other models; the paper releases code at github.com/llm-attacks/llm-attacks.3
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.