Study Finds AI Models Give Girls More Praise and Less Constructive Criticism Than Boys

When prompted to give feedback on students’ essays, AI chatbots respond differently depending on the students’ gender, according to a new study led by researchers in the Graduate School of Education at Stanford University in California.

The research team asked four different large language models (LLMs) to review 600 essays from middle school students and give writing feedback. Next, they submitted each essay to the LLMs 12 more times, but added additional info on the writer’s race, gender, and motivation level, as well as whether they had a learning disability.

Compared to the advice given to boys, feedback for essays authored by girls received more praise and less constructive criticism, demonstrating both feedback withholding and positive feedback biases. Girls’ feedback often used first-person pronouns and affective language that positioned the AI model as personally engaged with the student’s work. AI models were also more likely to encourage girls to link their arguments to empathy, respect, and relational responsibility.

In contrast, feedback for essays authored by boys was more objective and task-oriented, focusing on evidence, reasoning, and clarity and demonstrating a level of trust for students to handle criticism without relational cushioning.

“Taken together, these patterns suggest that LLMs enact Marked Pedagogies guided by stereotypes rather than pedagogical best practices,” the authors conclude. “Instead of providing feedback at multiple levels of writing or consistently signaling constructive trust in students’ capacity to revise, LLMs differentially calibrate feedback based on presumed identities, judging not only students’ current ability, but also their capability — placing lower ceilings on growth for students of marked attributes and, by implication, constraining their educational futures.”

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles

Latest News

A Trio of Women Selected to Lead Two-Year Colleges in California

Candace B. Jones was named president of Santa Monica College. Star Rivera-Lacey and Christine Holt-McDonald were named chancellor of the Riverside Community College District and the State Center Community College District, respectively.

Elizabeth Dumont Appointed Provost at the University of Vermont

Dr. Dumont has been serving as provost of the University of California, Merced. She is slated to become the next provost of the University of Vermont on January 4.

Tejal Desai to Leave Brown University for New Role at Vanderbilt San Francisco

Dr. Desai has served as dean of the Brown University School of Engineering for the past four years. She will step down from her deanship on December 31 and transition to Vanderbilt University's new campus in San Francisco, where she will direct the Institute of Innovation, Technology, and Translation.

Nefertiti Walker to Lead the University of Massachusetts Boston

Dr. Walker, a professor of sport management, currently serves as senior vice president for academic affairs, student affairs, and equity at UMass Amherst. She is slated to assume new responsibilities as interim chancellor of UMass Boston on February 1.

Three Women Are Among the First Winners of Schmidt Sciences’ New FirstLight Awards

Each awardee will receive as much as $500,000 annually for up to five years to build and lead a team that will seek to advance our understanding of the universe.

Instructional Professor of Quantitative Methods in MAPSS (Open Rank)

The University of Chicago Division of the Social Sciences invites applications for appointment as Instructional Professor at the rank of Assistant, Associate, or Full Professor, with a specialization in quantitative methods, in the Master of Arts Program in the Social Sciences.

Instructional Professor of Sociology in MAPSS (Open Rank)

The University of Chicago Division of the Social Sciences invites applications for appointment as Instructional Professor at the rank of Assistant, Associate, or Full Professor, with a specialization in Sociology, in the Master of Arts Program in the Social Sciences.

Instructional Professor of Psychology in MAPSS (Open Rank)

The University of Chicago Division of the Social Sciences invites applications for appointment as Instructional Professor at the rank of Assistant, Associate, or Full Professor, with a specialization in Psychology, in the Master of Arts Program in the Social Sciences.

Instructional Professor of Political Science in MAPSS (Open Rank)

The University of Chicago Division of the Social Sciences invites applications for appointment as Instructional Professor at the rank of Assistant, Associate, or Full Professor, with a specialization in Political Science, in the Master of Arts Program in the Social Sciences.

Assistant Dean of Academic Affairs (Associate Professor)

The USC Glorya Kaufman School of Dance invites applications for the position of Assistant Dean of Academic Affairs at the rank of Associate Professor with tenure. This is a full-time, tenured faculty appointment with administrative responsibilities, supporting the school's academic mission, curricular excellence, and student success.