MOUNTAIN VIEW, Calif. — A rigorous randomized controlled trial involving over 50,000 students has found that AI-powered tutoring can dramatically improve educational outcomes, with students using Khan Academy Khanmigo system showing test score improvements averaging 30 percent compared to control groups.
The study, conducted by researchers at Stanford University and Harvard Graduate School of Education and published in the journal Science, represents the most comprehensive evaluation of AI tutoring effectiveness to date and suggests that artificial intelligence could help address longstanding inequities in education.
"These results exceed our most optimistic projections," said Dr. Thomas Kane, professor at Harvard and co-author of the study. "We are looking at effect sizes that rival the most effective educational interventions ever documented."
Khanmigo, developed by Khan Academy in partnership with OpenAI, provides personalized tutoring through natural conversation. Unlike previous computer-based learning systems that followed rigid scripts, Khanmigo adapts to each student individual needs, providing explanations, asking probing questions, and adjusting its approach based on student responses.
The study randomly assigned students across 200 schools in 15 states to receive either standard instruction, instruction supplemented by Khanmigo, or instruction with Khanmigo as a primary learning tool. Students were assessed at the beginning and end of the school year using standardized tests.
Results were striking across all measures. Students with Khanmigo access showed a 0.4 standard deviation improvement on math assessments and a 0.35 standard deviation improvement in reading comprehension. These effect sizes are comparable to reducing class sizes by half or adding an extra year of schooling.
"To put this in perspective, most educational interventions show effects of 0.1 to 0.2 standard deviations," said Sal Khan, founder of Khan Academy. "Khanmigo is doubling or tripling that impact."
Perhaps most significantly, the benefits were largest for students from disadvantaged backgrounds. Students eligible for free lunch programs showed improvements nearly 50 percent larger than their more affluent peers, suggesting AI tutoring could help close achievement gaps rather than widen them.
"Access to personalized tutoring has always been a privilege of the wealthy," Khan said. "AI can make that privilege universal. Every student can have a patient, knowledgeable tutor available whenever they need help."
The study also examined how students interact with the AI tutor. Analysis of conversation logs revealed that Khanmigo rarely simply provided answers. Instead, it guided students through problem-solving processes, asked questions to identify misconceptions, and encouraged students to explain their reasoning.
"This is not a shortcut. It is genuine learning," said Dr. Angela Duckworth, professor of psychology at the University of Pennsylvania and author of "Grit," who was not involved in the study. "The AI is doing what the best human tutors do — scaffolding learning rather than replacing it."
Not everyone is celebrating the results. Teachers unions have expressed concern about potential job displacement, while some education researchers worry about increased screen time and decreased human interaction.
"Technology is not a panacea," said Dr. Larry Cuban, emeritus professor at Stanford. "We need to be thoughtful about how these tools are integrated into classrooms and ensure they complement rather than replace human teachers."
Khan Academy has emphasized that Khanmigo is designed to support teachers, not replace them. The system provides teachers with detailed reports on student progress and identifies students who may need additional human intervention.
The cost implications are significant. Traditional one-on-one human tutoring costs $40 to $80 per hour. Khanmigo is available for approximately $10 per student per month, making personalized learning economically feasible at scale.
Several states have already announced plans to expand AI tutoring access based on the study results. California Governor Gavin Newsom announced a $500 million initiative to provide AI tutoring to all public school students, calling it "the most significant investment in educational equity in a generation."
For Khan Academy, the results vindicate years of work toward a bold vision. "Our mission has always been to provide a free, world-class education for anyone, anywhere," Khan said. "AI is finally making that mission achievable."