Elsie Item-Writing Academy
About 45 minutes · Academy module: Distractor Engineering: Step 1 — Five Options, Zero Passengers
Unofficial faculty-development resource. Not affiliated with, endorsed by, or representing the AAMC, NBME, USMLE, LCME, or NRMP. Supports faculty-development documentation.
Step 1 items give you five options — more room for good distractors, and more ways for bad ones to hide. The distractor principles from the Foundations module carry over, but the vignette format and the basic-science-to-clinical bridge add Step 1-specific demands.
Homogeneity of length and detail. With five options, the long-key tell is even more tempting: authors unconsciously write the correct mechanism in full sentences and the distractors as fragments. Standardize the surface: same phrasing pattern, same depth, no option carrying unique qualifiers. A student skimming for the "most complete" answer should find five equally complete answers.
Common misconceptions as distractors. Step 1 is built on high-yield confusions — and your distractors should be too. The student who reaches for ciprofloxacin in pregnancy out of habit, or mistakes the route of epinephrine administration, is showing you exactly where teaching failed. Name the misconception when you draft the distractor; that note becomes your remediation plan when the item analysis confirms the pull.
The "second-best answer" trap. Deliberately include the option the almost-ready student chooses: the right drug at the wrong dose or route, the right diagnosis from the wrong mechanism, the correct next step performed too early. The second-best distractor is what separates an item that merely sorts from an item that teaches you where the cohort's understanding breaks down. But it must be unambiguously wrong — a second-best option that a content expert could defend is not a trap, it is a disputed key, and it fails the two-solver verification every rewrite in this track undergoes.
Avoiding the throwaway option. Five options make it easy to pad with an obviously wrong fifth. Resist it. A dead option inflates guessing odds and, worse, the item analysis will show a flat zero pull — which tells you nothing. Five live options or a rewritten stem.
Distractor ordering. Vary the key position across the exam; never let a pattern emerge (and never "balance" keys into a predictable rotation students can learn). Where options have a natural order — disease stages, drug doses — keep it; otherwise keep order neutral and consistent.
Feeding pooled data back into revision. The item analysis after a Step 1-style exam is your distractor laboratory. The p-value sets difficulty; the distractor pull diagnoses thinking. A distractor that draws a large share of the class is not a failure — it is a discovered misconception, and it belongs in your teaching. A distractor with zero pull across administrations is dead weight: replace it with a live misconception and re-pilot. When an item shows negative discrimination — the strongest students missing it at higher rates — treat it as a faculty-review flag: convene content review, check for a second defensible answer or a miskey, and revise deliberately. Never auto-rekey or auto-delete on statistics alone; the numbers flag, the faculty decides.
---
Flawed item (intended key: A)
A 62-year-old man with chronic alcohol use presents with confusion, ophthalmoplegia, and ataxia. Which of the following is the most appropriate treatment?
A) Intravenous thiamine before glucose administration B) Vitamin C infusion C) Magnesium infusion D) Ondansetron E) Observation
Flaw taxonomy label: Missing second-best distractor — distractors do not capture the live misconceptions.
Correction: The classic errors on Wernicke encephalopathy are giving glucose before thiamine (which precipitates deterioration) and giving oral rather than IV thiamine — and neither appears. The distractors are inert, so the item cannot locate where a student's understanding breaks down; it only separates those who know from those who guess. The rewrite installs the real traps: oral thiamine at the wrong dose and route (the "I know it's thiamine" student), the glucose-first error (the dangerous misconception), and two ward-plausible but wrong treatments. Each distractor now maps to one nameable gap.
Model rewrite — cold-solve verified: 2/2 (solver 1: E, solver 2: E)
A 62-year-old man with chronic alcohol use presents with confusion, ophthalmoplegia, and ataxia. Which of the following is the most appropriate treatment?
A) Oral thiamine 100 mg daily B) Intravenous glucose bolus immediately C) Lorazepam for alcohol withdrawal D) Haloperidol for agitation E) Intravenous thiamine before glucose administration
Key: E
Flawed item (intended key: A)
A 22-year-old woman develops diffuse urticaria, lip swelling, wheezing, and hypotension with blood pressure 82/50 mm Hg within minutes of a bee sting. Which of the following is the most appropriate immediate treatment?
A) Intramuscular epinephrine B) Intravenous diphenhydramine C) Oral prednisone D) A warm blanket and reassurance E) Nebulized albuterol
Flaw taxonomy label: Throwaway option.
Correction: Option D is not a treatment anyone would choose for anaphylactic shock — it is padding, and it quietly converts a five-option item into a four-option item while teaching students that your exams contain free eliminations. The repair keeps the genuinely instructive distractors (antihistamines and steroids are real errors — they are adjuncts, not first-line; albuterol treats only the wheeze) and replaces the padding with the live route misconception: subcutaneous epinephrine, the outdated administration route students still encounter in old teaching. Now all five options must be evaluated on content.
Model rewrite — cold-solve verified: 2/2 (solver 1: A, solver 2: A)
A 22-year-old woman develops diffuse urticaria, lip swelling, wheezing, and hypotension with blood pressure 82/50 mm Hg within minutes of a bee sting. Which of the following is the most appropriate immediate treatment?
A) Intramuscular epinephrine B) Intravenous diphenhydramine C) Oral prednisone D) Subcutaneous epinephrine E) Nebulized albuterol
Key: A
Flawed item (intended key: C)
A 45-year-old man with HIV (CD4 count 120 cells/mm³) presents with headache and fever. Cerebrospinal fluid shows elevated opening pressure, low glucose, high protein, and encapsulated yeast on India ink preparation. Which of the following is the most likely organism?
A) Candida albicans B) Aspergillus fumigatus C) Cryptococcus neoformans D) Histoplasma capsulatum E) Treponema pallidum
Flaw taxonomy label: Implausible distractor (zero-pull option).
Correction: Option E is a spirochete — a bacterium — offered against encapsulated yeast on India ink. It will pull zero responses in every administration, which means it contributes nothing: no discrimination, no diagnostic information, just a free elimination. Pooled data would flag it immediately as a zero-pull distractor. The revision rule for zero-pull options is to replace, not remove: substitute a live misconception from the same category — here, Mucor, another fungus students genuinely confuse in the immunocompromised host — so the option set stays at five real alternatives.
Model rewrite — cold-solve verified: 2/2 (solver 1: C, solver 2: C)
A 45-year-old man with HIV (CD4 count 120 cells/mm³) presents with headache and fever. Cerebrospinal fluid shows elevated opening pressure, low glucose, high protein, and encapsulated yeast on India ink preparation. Which of the following is the most likely organism?
A) Candida albicans B) Aspergillus fumigatus C) Cryptococcus neoformans D) Histoplasma capsulatum E) Mucor species
Key: C
---
Recording it adds the module to your Academy completion record on this device — module, track, level, and date, ready to download from your account page for faculty-development documentation.