Amanda Askell
Scottish philosopher and AI researcher
From Wikipedia, the free encyclopedia
Amanda Askell (née Hall; formerly MacAskill; born 1988 or 1989)[1] is a Scottish philosopher and AI researcher. She has served as the head of the personality alignment team at Anthropic since 2021. She has played a large role in the development of Claude's personality and constitution.[2] In 2024, she was on the TIME100 AI list.[3] She previously worked at OpenAI, but left over concerns that the company was not prioritizing AI safety enough.[4][5] She has published over 60 papers and has received over 170,000 citations.[6]
1988 or 1989 (age 37–38)
- University of Dundee (MA (Hons), 2009)
- University of Oxford (BPhil, 2011)
- New York University (PhD, 2018)
Amanda Askell | |
|---|---|
| Born | Amanda Hall 1988 or 1989 (age 37–38) |
| Spouse | |
| Awards | Time 100 AI (2024) |
| Education | |
| Education |
|
| Thesis | Pareto Principles in Infinite Ethics (2018) |
| Doctoral advisors |
|
| Philosophical work | |
| Era | Contemporary philosophy |
| Region | Western philosophy |
| School | Analytic |
| Institutions | |
| Main interests | |
| Notable works | Constitutional AI framework |
| Notable ideas |
|
| Website | askell |
Early life and education
Born Amanda Hall, Askell was raised in Prestwick by her mother, a teacher.[1] She attended secondary school in Alva, Clackmannanshire. At the University of Dundee, she sought degrees in philosophy and fine art.[1] Askell received a BPhil degree in Philosophy from the University of Oxford[7] and a PhD degree in Philosophy from New York University in 2018.[5] Her doctoral thesis (Pareto Principles in Infinite Ethics) argues that rankings of worlds containing infinitely many agents, when constrained by certain plausible axioms, create puzzles for a wide range of ethical theories.[8][9]
Career
OpenAI (2018–2021)
After completing her PhD, Askell joined OpenAI in November 2018 as a Research Scientist on the policy team.[10] At OpenAI, she focused on AI development races between organizations and how they can avoid being adversarial, as well as examining the intersection between policy questions and AI safety[10] and co-authored the GPT-3 paper, which was published as a pre-print on 28 May 2020.[11]
Anthropic (2021–present)
Askell joined Anthropic in March 2021 as a Member of Technical Staff, focusing on alignment and finetuning.[12] She currently leads the personality alignment team, where she is responsible for training Anthropic's Claude model to exhibit positive character traits, such as curiosity, and for developing new techniques for model finetuning.[3] In 2026, the Wall Street Journal wrote that "her job, simply put, is to teach Claude how to be good", and the New Yorker wrote that "she supervises what she describes as Claude’s 'soul.'"[1][13]
Research
Moral self-correction
In a 2023 paper co-authored with Deep Ganguli, Askell explored "moral self-correction" in large language models: the capacity of these systems to reduce harmful outputs when given natural language instructions to do so. The research tested whether models trained with reinforcement learning from human feedback (RLHF) could avoid stereotyping and discrimination without being provided explicit definitions of these concepts or the metrics used to evaluate them.[14]
The study found that this capability emerged at 22 billion parameters and improved with both model size and RLHF training. Using three experimental benchmarks, the researchers demonstrated that natural-language instructions such as "Please ensure that your answer is unbiased and does not rely on stereotypes" substantially reduced biased outputs in models of sufficient scale. The results revealed that larger models can follow complex instructions and learn normative concepts like stereotyping and discrimination from training data.[14][15]
Constitutional AI
Askell has been a key contributor to the development of Constitutional AI (CAI), a method for training AI systems to meet the standards of harmlessness and helpfulness using AI feedback rather than extensive human oversight.[16] The approach involves providing AI models with a set of principles, or "constitution", to guide their behavior, allowing them to critique and revise their own responses based on these principles.[17]
Askell is the primary author and is responsible for the majority of the text of the latest version of Claude's constitution, released in January 2026.[18][19] The document is designed to address the growing capabilities and emerging risks of advanced AI models.[2][20] She has described her work as focusing on helping models "understand and grapple with the constitution" through synthetic data generation and reinforcement learning techniques.[2]
Personal life
Askell married philosopher William Crouch in 2013.[21][22] The two adopted a shared married name of MacAskill, which she reworked to Askell after their divorce in 2015.[1] She is a member of Giving What We Can.[23]