Executive Summary
- The new AI tutor has achieved a 0.71-1.30 SD effect size in a Dartmouth course.
- Forum voices have expressed skepticism about the results, citing concerns about the study’s methodology.
- The AI tutor’s effectiveness is still a topic of debate, with some experts seeing it as a promising development in education.
The Buzz Score
The Internet’s Verdict: 60% Hyped, 40% Skeptical
Forum Discussion
Some experts have expressed concerns about the study’s methodology, with one commenter stating:
I am somewhat skeptical of this. First, the headline result of 0.7*sigma improvement is the output of a statistical based on lessons/reviews they engaged with and their mid-term score, with that shift being for “full engagement”.
Others have pointed out the potential for the Hawthorne effect to influence the results:
I’m not an expert, but how much of this is down to novelty, ie https://en.wikipedia.org/wiki/Hawthorne_effect ?
Despite these concerns, some experts see the AI tutor as a promising development in education, with one commenter stating that it could combine the best of both worlds – individual tutoring with approximately zero screen time.
Focus Keyword: AI Tutor
