medRxivJClub
Interpreting Self-Reported Outcomes After AI-Assisted Writing Workshops: An Aggregate Sensitivity Analysis of Educational Claims
medRxiv · · Preprint · Open access
Mercer, Reed + 2 more
Abstract ↗AI summary
The abstract is read at the publisher; the summary is JClub's.
In a single-institution health-professions AI-assisted academic-writing workshop, 84.4% of 64 respondents reported improved understanding, with a 73.6%–91.3% working-model interval.
- Why it matters: Immediate self-reports after AI writing workshops can be misread as proof of learning or ethical competence, even though they may not measure objective outcomes.
- What they did: Using an aggregate-data interpretation framework, public respondent counts were classified by construct and reanalyzed with registered-list identification intervals that assigned every nonrespondent first to non-positive then to positive.
- The result: With 80 registrants, identification intervals were 67.5%–87.5% for perceived improvement and 56.2%–76.2% for confidence and perceived ethical improvement, supporting bounded descriptions of respondent experience only.
The findingWhy it mattersWhat they didThe result
AI summary of the abstract · may contain errors · not medical advice · read the paper.
- Open access