💡 If you clicked "Next Time" on the AI-Assisted Item Generator prompt, you'll land in the manual item editor. The choice is per item: you can always use AI on your next item.
At the top of the editor, you'll always see:
- Topic and Topic Description: Confirm you're writing for the right topic before you start.
- Item Type: the format you selected (e.g., Single Correct Response - Four Options). Click the ✏️ pencil icon to change it.
❓ Why would I write manually instead of using AI?
Experienced item writers often find it faster to write from scratch than to untangle an AI draft, especially for items requiring precise domain language or nuanced scenarios. Both paths lead to the same editor and the same review workflow. Manual writing just skips the generation step.
Choosing Your Editor Mode
The toggle in the upper-right offers two ways to work. Both produce the same item; pick whichever suits how you write:
- Form: the entire item on a single scrolling page: question, answers, rationales, citation, and difficulty slider all in one view. Best for writers who want to see everything at once.
- Wizard: a guided, five-step path with numbered stages: 1 Question → 2 Correct Answer → 3 Incorrect Answers → 4 Rationales → 5 Overall. Click "Next" to advance. Best for first-time writers who want the editor to walk them through it.
Writing the Item
7.2.1 Write your question in the stem field. It must be phrased as a question and worded positively.
⚠️ The platform checks stem phrasing as you write. Negative constructions (e.g., "Which of the following should you NOT do?") will trigger a warning, and you'll need to rephrase positively to continue.
❓ What makes a good stem?
A strong stem presents one complete, focused problem that a candidate could realistically encounter on the job. It should stand alone: the candidate should know what's being asked before reading the answer options. Anchor it in a realistic scenario, test one thing only, and keep the wording as direct as possible.
7.2.2 Write 1 correct answer, and in the Rationale field beneath it, explain why it is correct.
7.2.3 Write your incorrect answers (three, for a Four Options item), each with its own rationale explaining why it is incorrect.
⚠️ Answer options are also checked for phrasing: word every option as an affirmative action, even the incorrect ones. Options built around "decline," "do not," or "avoid" can trigger the negative-phrasing warning.
❓ What makes a good distractor?
A good distractor is plausible to someone with partial knowledge but clearly wrong to someone qualified. Each should represent a distinct, real misconception. Keep all options parallel in length and structure: an option that is noticeably longer or more detailed than the others can unintentionally signal the correct answer.
7.2.4 Cite the reference material supporting your question and correct answer in the citation field. Use an authoritative source for the content area (a regulation, standard, or official documentation), not a general search engine.
7.2.5 Set the difficulty slider: "What percentage of qualified candidates will answer this question correctly?" The value must be between 25 and 100 inclusive.
💡 As you adjust the slider, the platform reflects your estimate back to you (e.g., "Your evaluation suggests that most Qualified Candidates will answer correctly. Is that true?"). Treat it as a sanity check: if the statement doesn't match your intent, adjust.
❓ Why do I need to set a difficulty percentage?
This is your Angoff estimate: a judgment call about how a minimally qualified candidate would perform on this item. It feeds directly into standard setting and helps determine where the passing score lands. Even a rough but honest estimate from a subject matter expert is more defensible than no estimate at all.
Adding an Exhibit (Optional)
7.2.6 To attach supporting material to your item, click "+ Exhibit" in the header. Exhibits provide the test taker with information necessary to answer the question, such as an image, data table, block of code, or reading passage.
- Exhibit text: the content itself (Required).
- Description: what the exhibit is (Required).
- Notes: internal notes for reviewers (Optional).
- Keywords: enter each keyword and press Enter, useful for finding and reusing exhibits later.
7.2.7 Click "Save Exhibit" to attach it, or "Cancel" to discard.
Previewing and Submitting
7.2.8 Toggle Preview Mode (upper-right) to see the item exactly as a candidate would: stem and answer options only, with no rationales or metadata visible.
💡 Editing is disabled while Preview Mode is on. Toggle it back off to make changes or submit.
7.2.9 Choose your exit path from the footer:
- Save Draft: keep your progress and return later via My Items.
- Submit for Review: send the item into the review workflow.
- Abandon Item: discard the item entirely.
- Cancel without saving: leave the editor without keeping changes.
⚠️ Submit for Review stays disabled until every Required field is complete: the stem, all answers, all rationales, the citation, and the difficulty slider. If the button won't enable, scroll the full form and look for any field still marked "Required" beneath it.
After Submitting
7.2.10 Once you click "Submit for review", the item leaves your editing queue and enters the review workflow. You're returned to the Item Writing view.
💡 The topic's metrics update in real time: your submitted item moves out of the writable pool and into review. You can track your submitted items anytime via My Items in the sidebar.
Next step → Step 7.3: The Item Review Process
Updated
Comments
0 comments
Please sign in to leave a comment.