You are invited to evaluate AI's philosophical capabilities.
PhilosophyBench is a Stanford University research study evaluating AI systems’ ability to write English-language philosophy.
We study whether AI can develop original philosophical ideas with clarity, depth and sophistication.
This research study has been approved by Stanford University’s Institutional Review Board (IRB). PhilosophyBench is advised by an international group of philosophers and computer scientists, including Ruth Chang, Ned Block, Nancy Cartwright, Joshua Cohen, Kit Fine, Ned Hall, Gideon Rosen, Jonathan Schaffer, Susan Wolf, Crispin Wright, Stephen Yablo, Linda Zagzebski, Michael Cheng, Isaac Robinson, Neil Band, Zachary Lang, Sebastian Thrun, Chris Re, and Michael Bernstein.
We will follow all privacy and confidentiality requirements of Stanford’s IRB, including the requirement that data is only used for the purposes of this study, which explicitly exclude training or providing study data to AI model developers (including Anthropic, OpenAI, Meta, Google Deepmind, Deepseek, xAI, Kimi, et al). The goal of this project is not to collect data to train or improve AI models, but rather to independently evaluate the extent that AIs can write philosophy through a statistically validated methodology.
Join PhilosophyBench
We’re looking for people with a background in philosophy. We welcome participants who are professional philosophers, graduate students, or advanced philosophy undergraduates, as demonstrated through formal education or other appropriate evidence. We especially encourage participation from those interested in answering research questions concerning the philosophical capabilities of AI.
If you are interested in participating in PhilosophyBench, please sign up ASAP by October 15, 2026.
Participation requires a minimum commitment of 10 hours, with the scope of your involvement tailored to your interests and availability. Participation could include grading essays, writing essays, providing comments on essays, or other common philosophical tasks.
We will provide reasonable compensation for your time commensurate with an academic research study.