💡 Reviewing is where submitted items earn their way into the pool. Reviewers work the For Review queue in Item Management, evaluating each item against structured quality checks before every topic's Accepted count meets its target.
9.0.1 — Opening the Queue
Open Item Management → For Review to see every item awaiting review, with the Organization and Published Blueprint context at the top, a Search by Item Content field, Bulk Actions, and Import Items.
The list shows Item Name, Item Type, Item Quality, Authoring Status, and Created, alongside your familiar status sidebar.
9.0.2 — Filtering the Queue
Each column has a filter icon (the funnel/bars, before the column's ⋮ menu). Filter types match the column's data:
- Item Name / Item Type: text match (Contains, Does not contain, Equals, Does not equal, Begins with, Ends with, Blank, Not blank)
- Item Quality: color-coded selector (RED, GREEN, YELLOW, NONE)
- Authoring Status: a searchable status list (e.g., "For Review")
- Created: a comparison operator (Equals, Does not equal, Before, After, Between, Blank, Not blank) paired with a date picker
💡 These filters are self-explanatory in use — no further breakdown needed here.
9.0.3 — Opening an Item
Click an item to open its detail panel: Item, Summary, History, Enemy Items, Statistics, and Notes tabs, landing on History by default. The History table logs every status transition with Date, Action, Previous Status, and New Status.
❓ Why does "Review Completed" sometimes lead back to For Review instead of a final status?
This likely reflects a blueprint configured to require more than one independent review before an item reaches a terminal status (Accepted, For Revision, For Rewrite, or Rejected) — the "SME reviews per item written" setting in Advanced Settings governs this. One completed review counts toward the requirement, but the item returns to For Review until enough reviews accumulate. [VERIFY: confirm the exact review count required on this blueprint, and whether the History tab shows which reviewer or how many reviews remain.]
9.0.4 — Starting a Review
Click the Review Item icon (speech bubble with a pencil, above the tabs) to begin. A modal sets expectations: "You must complete this review within 2 hours. Typical reviews take from 5–15 minutes to complete." It explains your role — evaluating another SME's item against research-based writing principles — and offers support contact (Contact Us chat, or support@certiverse.com). Click Continue to begin, or Cancel to back out.
⚠️ Once started, the 2-hour window is real: don't begin a review you can't finish in that time.
9.0.5 — Step 1: Answer Item
You'll preview the item exactly as a candidate would: the stem and all answer options. Mark the answer you believe is correct as if you were a test-taker. The platform tells you whether your choice matches the author's designated key ("Your selection matches the Author's choice") before you proceed. Click Next.
❓ Why answer the item myself before seeing anything else?
This is a blind check: answering as a candidate, before reading the author's rationale, tests whether the correct answer is genuinely the most defensible choice on its own merits. If an experienced reviewer picks the "wrong" answer without any coaching, that's a strong signal the item itself is flawed — a distractor may be too plausible, or the key may not be as clearly correct as the author intended.
9.0.6 — Step 2: Question Review
The right panel presents Review Questions, each a Yes/No judgment:
- Is the question clear?
- Is the correct answer(s) the only correct answer(s)?
- Does the correct answer(s) stick out?
- Are the incorrect answers plausible?
Then an overall disposition — Does this item pass your review? — with three options: Clearly Pass, Pass with minor changes, or Clearly Fail.
Finally, set your own difficulty estimate: "What percentage of qualified candidates will answer this question correctly?" (25–100%, with the same sanity-check banner you've seen during authoring). This is the complete panel — nothing sits below the difficulty slider. Click Save to hold your progress, or Submit Review to finalize.
❓ Where does detailed written feedback (like a specific note on a weak distractor) come from, if there's no comment field here?
This structured review screen doesn't include a free-text field for the reviewer. Narrative feedback of the kind an author sees on a returned item (naming a specific distractor and explaining why it's weak) appears to come from Certiverse AI's automated review process, which generates that level of detail programmatically rather than through this manual UI. [VERIFY: check the item's Notes tab to confirm whether a human reviewer has any avenue to leave freeform commentary outside this structured flow, since as captured, a human reviewer's only inputs are the Yes/No answers, the three-way disposition, and the difficulty slider.]
9.0.7 — After Submitting
Click Submit Review. A brief "Review Submitted — Redirecting" confirmation appears before you're returned to the Item Management dashboard.
Queue counts update to reflect the completed review.
❓ What does each disposition option actually do to the item's status?
[VERIFY before publishing.] The likely mapping: Clearly Pass moves the item toward Accepted, Pass with minor changes returns it as For Revision, and Clearly Fail results in For Rewrite or Rejected depending on severity — but this hasn't been directly confirmed against the item's resulting status. Submit a review with each disposition on a test item and check the resulting Authoring Status to confirm.
💡 Track pool health from the Blueprint Progress dashboard: when every topic's Accepted count meets its target, the pool is form-ready.
💡 If AI Item Review is enabled, Certiverse AI performs this same review flow — the same quality questions, disposition, and difficulty estimate — attributed to "Certiverse AI" in the item's History tab (see Step 8.1).
Next step → Step 10: Creating the Exam
Updated
Comments
0 comments
Please sign in to leave a comment.