Attrition Bias in AI-Administered Interviews
Who finishes an AI-administered interview, and how does that group differ from who finishes a standard survey? We report a pre-registered four-arm randomized experiment (N = 1,591) assigning Danish online-panel adults to a standardized survey, a standardized chat, an adaptive AI chat, and an extended adaptive AI chat, all covering same substantive content. Completion falls monotonically from 91.8% to 66.7% across arms. The chat interface drives most of the gap (a 14.6 percentage-point drop), limited adaptive probing adds almost nothing (2.3 percentage-point), and extended probing leads to exhaustion and attrition (8.2 percentage-point). Dropout is socially selective: in the most demanding arm, respondents aged 18 to 34 are more likely to complete than those aged 56 and older, and completers are more educated and more likely to use a computer rather than a smartphone. AI-interview samples are therefore younger, more educated, and more desktop-oriented, with direct consequences for inference of results.
@unpublished{stahlschmidt2026attrition,
title = {Attrition Bias in AI-Administered Interviews},
author = {Stahlschmidt, Mikkel H. and Gaardhus, Tobias Priesholm and Carlsen, Hjalmar Bang},
note = {Working Paper},
year = {2026},
month = june,
}