Elsie Item-Writing Academy
About 15 minutes · Academy student tutorial: Question-Writing as a Study Technique
A student tutorial from the Elsie Item-Writing Academy — an unofficial faculty-development resource, not affiliated with or endorsed by the AAMC, NBME, USMLE, LCME, or NRMP.
Reading a chapter feels productive. It mostly isn't. The moment you try to write a test question about what you just read, everything changes: you have to decide what matters, phrase it precisely, invent three wrong answers that sound right, and defend the one right answer. That work forces you to organize the material instead of merely recognizing it.
Learning scientists have a name for the underlying idea — the generation effect: material you produce yourself sticks better than material you only read. (That is established learning-science framing, not a statistic about how much better.) Writing an item is generation with a built-in quality check — if you cannot write a clean question about a topic, you do not understand it yet, and now you know exactly where the gap is.
1. Draft. After studying a topic, write one 4-option multiple-choice item about it: a focused stem that asks one clear question, one correct answer, and three distractors a classmate might plausibly choose. 2. Check. Run your draft through Question Studio — a faculty tool students can also use to cold-solve-check their own practice items. Studio cold-solve-checks every item — an independent read that verifies the key is actually correct and the distractors are actually wrong — so you never drill yourself on a wrong key. If Studio flags a flaw, fix the item; the fix is where the learning happens. Items you draft save to your own library on this device — they never join the verified bank without the full faculty review pipeline. 3. Quiz. A week later, answer your own item cold, without your notes. If you get it right and can explain why each distractor is wrong, the topic is yours.
One honest note: Studio's check is a safety net for your answer key, not a substitute for understanding. It catches wrong keys; the judgment about what to study is still yours.
Illustrative example — not a live Studio run.
A student finishing a psych/soc chapter on memory drafts this item:
Which of the following best describes the testing effect?
A) Repeatedly reading material to strengthen memory
B) Retrieving information from memory to strengthen later recall
C) Studying in the same room where the test will occur
D) Teaching material to another student
The key is B. The student runs it through Question Studio, which cold-solve-checks it — and flags a flaw: options A, C, and D name real study strategies (rereading, context-dependent learning, teaching others), but they are a grab bag rather than distractors competing on the same idea. The stem is fine; the distractors are weak because they don't force a real decision. The student revises: A) "Restudying material without attempting recall," C) "Spacing study sessions across several days," D) "Highlighting key terms while reading." Now every option is a study strategy, and only B describes the testing effect. The revision took five minutes — and the student will not forget the testing effect.
That revision loop is the whole technique. The item you end up with matters less than the thinking the rewrite forced.
When you're ready, open Question Studio (faculty tool).
Recording it adds the module to your Academy completion record on this device — module, track, level, and date, ready to download from your account page for faculty-development documentation.