# Instructor‑designed AI boosts test scores in multi‑university study

> A randomized trial at 19 colleges found AI tools created by teachers improved exam performance for 7,200 students.

Oossa · 2026-11-17 · https://oossa.com/en/instructor-designed-ai-boosts-test-scores-in-multi-university-study

Researchers reported the results of a pre‑registered randomized controlled trial that ran across three semesters at 19 universities. The study involved 7,200 students who used AI applications that were built by the instructors of their own courses. The AI tools varied widely – from automated feedback on essays to custom problem‑generation scripts – because each teacher designed what they thought would help their class most. When the semester ended, students took proctored, in‑person exams that could not be aided by AI. Those who had used the instructor‑designed tools scored higher on these “AI‑proof” assessments than peers who used no AI or generic chatbot solutions.

The trial did not find any measurable shift in how often students logged into course platforms, nor did it change the ratings students gave in course evaluations. In other words, the AI interventions improved learning outcomes without increasing overall engagement or satisfaction scores. The authors note that previous work has shown generic AI tools sometimes hurt learning, but this study suggests that when teachers control the design, AI can be a net benefit.

The research team, led by Jun Li and colleagues from multiple institutions, posted the paper on arXiv on 14 November 2026. The study was pre‑registered, meaning the hypotheses and analysis plan were publicly recorded before data collection began, which helps reduce bias. The authors call for universities to give faculty more freedom to experiment with AI that fits their specific teaching context.

## Why teacher‑led AI matters now

Most universities today adopt campus‑wide AI platforms that are developed by tech firms or central IT units. Those solutions are often one‑size‑fits‑all and may not align with the nuances of a particular discipline or class size. This trial shows a different path: letting instructors tailor AI to their own pedagogical goals can lead to measurable gains in learning.

If colleges adopt policies that let faculty prototype and iterate on AI tools, they could see similar improvements without the need for costly enterprise licenses. The study also hints that student satisfaction may not be the right metric for AI success; learning gains can occur even when students do not report higher enjoyment.

However, the paper does not provide long‑term follow‑up data, nor does it explore whether the same benefits would appear in online‑only courses or with larger student populations. Further research will be needed to confirm that the results hold outside the controlled trial setting.

## The facts

- The trial involved 7,200 students across 19 universities.
- Student learning was measured with proctored, in‑person exams that could not be assisted by AI.
- No change was observed in course activity logs or student satisfaction ratings.
- The study was pre‑registered and the paper was posted on arXiv on 14 November 2026.

## Why it matters

For college students, AI tools built by their own teachers could help them perform better on exams without requiring extra study time. For faculty, the results suggest they can safely experiment with custom AI solutions to boost learning outcomes, even if overall class engagement stays the same.

## Sources & references

1. [Instructor-designed AI improves learning in a randomized trial across 19 universities](https://arxiv.org/abs/2611.19099) – arXiv, 2026-11-17

Last updated: 2026-11-17
