AssociationAI / AI Literacy

Live demo

Beginner

Try it: AI stand-in survey answer check lab

This is the working lab from our tutorial on checking AI stand-in survey answers against results you already have. Each row is one survey question for one member group at the Invented Tessalind Association of Community Pharmacists: what members actually said, what an AI asked to answer as that group said, and whether a rerun of the same prompt matched.

Invented organization and survey results for practice. The lab checks only the numbers you type on this page. It does not call any AI tool and sends nothing anywhere.

Pick a case

Results in this case

Row Real % agree AI % agree Real options used (of 5) AI options used (of 5) Rerun

Rules, in order (first match wins)

  1. R1, STOP: the AI's % is 15 points or more from the real %.
  2. R2, STOP: the AI used 2 or more fewer answer options than members did.
  3. R3, FIX: a value is blank, not a number or out of range (percentages 0 to 100, option counts whole numbers 1 to 5). A blank is never read as 0.
  4. R4, FIX: the rerun changed, or wasn't run.
  5. R5, FIX: the gap is 5 points or more, or the AI used 1 fewer option.
  6. R6, PASS: everything else.

Teaching choices: the 15-point and 5-point gaps, the 2-option and 1-option lines, the STOP and FIX split, and the rule order. None of them comes from the research. The research we draw on studied feeling-thermometer scores, not agree or disagree items; the % agree and option counts here are our adaptation.

Result

RowReal %AI %Real optionsAI optionsRerunVerdictRule IDMessage
Pick a case.

Not checked yet.

Plain-text record (select and copy it by hand)

Nothing checked yet.

This is a teaching tool. A PASS means one AI result sat close to one past member result on this page. It is a check against past members, not a replacement for asking them.