Live demo
BeginnerTry it: AI stand-in survey answer check lab
This is the working lab from our tutorial on checking AI stand-in survey answers against results you already have. Each row is one survey question for one member group at the Invented Tessalind Association of Community Pharmacists: what members actually said, what an AI asked to answer as that group said, and whether a rerun of the same prompt matched.
Invented organization and survey results for practice. The lab checks only the numbers you type on this page. It does not call any AI tool and sends nothing anywhere.
Pick a case
Results in this case
| Row | Real % agree | AI % agree | Real options used (of 5) | AI options used (of 5) | Rerun |
|---|
Rules, in order (first match wins)
- R1, STOP: the AI's % is 15 points or more from the real %.
- R2, STOP: the AI used 2 or more fewer answer options than members did.
- R3, FIX: a value is blank, not a number or out of range (percentages 0 to 100, option counts whole numbers 1 to 5). A blank is never read as 0.
- R4, FIX: the rerun changed, or wasn't run.
- R5, FIX: the gap is 5 points or more, or the AI used 1 fewer option.
- R6, PASS: everything else.
Teaching choices: the 15-point and 5-point gaps, the 2-option and 1-option lines, the STOP and FIX split, and the rule order. None of them comes from the research. The research we draw on studied feeling-thermometer scores, not agree or disagree items; the % agree and option counts here are our adaptation.
Result
| Row | Real % | AI % | Real options | AI options | Rerun | Verdict | Rule ID | Message |
|---|---|---|---|---|---|---|---|---|
| Pick a case. | ||||||||
Not checked yet.
Plain-text record (select and copy it by hand)
Nothing checked yet.
This is a teaching tool. A PASS means one AI result sat close to one past member result on this page. It is a check against past members, not a replacement for asking them.