Machines & Meaning · Capstone brief
HUM-06 · Citation theater
Audit an LLM's citations on a humanities query; design a verification protocol students must follow.
The question
Audit an LLM's citations on a humanities query; design a verification protocol students must follow.
Texts / materials
One humanities query run through a school-approved LLM. Citation audit worksheet (exists? says that? page/DOI?). Verification protocol for class use. No invented papers in the student’s own bibliography.
Expected failure modes
Stopping at “the link is blue.” Reproducing hallucinated citations in the works cited. Declaring all AI citations fake from three examples without a protocol.
Done looks like
Audit table with outcomes; protocol one-pager; class FAQ; non-claim list about what hallucination rates the student did not estimate.
Five C's
CT: fluent ≠ sourced. CR: protocol design. CO: peer re-audits two citations. CM: protocol page. CZ: future students who would have cited ghosts.
Mentor role
Librarian or humanities teacher stress-tests the protocol. School-supervised.
Rubric calibration
R1: one query domain. R2: audit reproducible. R3: human verification baseline. R4: sample limits. R5: protocol usable Monday. R6: student bibliography is clean.
Two ways this goes wrong
(a) Hot take, no table. (b) Works cited includes the hallucinations.
Credit lane fit
Lane A immediately. No verified credit claim.