Machines & Meaning · Capstone brief

HUM-06 · Citation theater

Audit an LLM's citations on a humanities query; design a verification protocol students must follow.

The question

Audit an LLM's citations on a humanities query; design a verification protocol students must follow.

Texts / materials

One humanities query run through a school-approved LLM. Citation audit worksheet (exists? says that? page/DOI?). Verification protocol for class use. No invented papers in the student’s own bibliography.

Expected failure modes

Stopping at “the link is blue.” Reproducing hallucinated citations in the works cited. Declaring all AI citations fake from three examples without a protocol.

Done looks like

Audit table with outcomes; protocol one-pager; class FAQ; non-claim list about what hallucination rates the student did not estimate.

Five C's

CT: fluent ≠ sourced. CR: protocol design. CO: peer re-audits two citations. CM: protocol page. CZ: future students who would have cited ghosts.

Mentor role

Librarian or humanities teacher stress-tests the protocol. School-supervised.

Rubric calibration

R1: one query domain. R2: audit reproducible. R3: human verification baseline. R4: sample limits. R5: protocol usable Monday. R6: student bibliography is clean.

Two ways this goes wrong

(a) Hot take, no table. (b) Works cited includes the hallucinations.

Credit lane fit

Lane A immediately. No verified credit claim.