Results Management Guide: Beta Rescore

Administrator's Guide: Beta Rescore 

This guide describes how to rescore responses from an unscored beta exam to a scored, live, operational exam.  

BACKGROUND: A beta exam consists of unscored pretest items. Candidates take the beta exam knowing that their scores and reports will be delayed. Certiverse provides the rescore feature to score and report results for beta candidates on the live, operational exam by rescoring responses from a beta exam to a final, live exam form.  

IMPORTANT: Rescoring can only happen after one or more live forms have been fully finalized and approved for the operational exam. Do not rescore until all exam development steps have been completed (the beta period is concluded, the pretest data are analyzed, operational forms have been selected, a cutscore has been determined for each form, and all settings of the exam and all target forms have been carefully checked). Usually, the exam and forms should be approved and active. 

Step 1. Rescore a beta response onto a live exam 

1. Go to Results Management Portal
2. Select the Beta Exam form.
3. Select Candidate(s) for scoring. Select the candidates for scoring. You can select all candidates or select individual ones by checking the box next to their record.
4. Select the Rescore icon in the upper-right corner of the screen
5. Select the live, operational exam.
6. Select the desired target forms.
7. Click Next. 
   Optional: If some items need special handling, enter the item names of the items. Scoring is modified so that all candidates who completed an item in this list will receive full credit for that item. Otherwise, leave this field blank.
   
   Note: Rescoring a beta exam across two operational forms is typical. When rescoring across multiple forms, the system will automatically award a candidate the score on the form that yields the best possible score for the candidate. 
8. Click Submit.
   Another pop-up will appear: "Confirm: This will rescore results against all the selected Exam Forms."
9. Click OK.
   A warning will display: "Rescoring for these results submitted." 

Step 2. Evaluate the staged results 

The candidate results are now 'staged' for the live, operational exam, and ready for publication after you verify that the scoring configuration is correct.

Note: The rescored results will appear with the live, active exam selected in the Exam* drop-down. 

1. Go to Results Management Portal
2. Select the Live, Operational Exam
3. Review the forms awarded. If the live, operational exam has two forms, the “Rescored Exam Form” should show each form for roughly half of the candidates. If one form predominates, it is easier than the other form (this may be corrected by resampling the two forms).
4. Review the “Raw Score,” “Reported Score,” and “Pass/Fail” columns. The raw score is the number of items answered correctly. The reported score uses the chosen metric (raw score, percent, scales score, etc.). Verify that scoring was configured correctly by verifying that the same reporting method is used for all forms and that the scoring method and cutscore were applied correctly. (For example, if the reporting score is “Percent” and the cutscore is 70% then all candidates should show percent scores for “Reported Score” and the percent score should reflect the raw score and those who attain 70% and above should be a “Pass” and the rest “Fail.”
   TIP: You may use the “Raw Score”, “Reported Score”, or “Pass/Fail” column to sort the result records. This is useful for double-checking your pass/fail cutpoint.
5. Optional: Review the passing rate. Calculate the passing rate by noting the number of records, then entering “Pass” in the “Pass/Fail” filter box and noting the number who passed. The passing rate = (number of people who passed / number of records).
6. Optional: Review the outcomes of the known candidates. Ensure that candidates who are expected to pass were awarded a “Pass” and that candidates known to have less knowledge (e.g., students, trainees, etc.) tend to have failed.

Step 3. Publish the staged Rescored Results 

After verifying that the staged results are acceptable, the results need to be published. 

1. Go to Results Management Portal
2. Select the Live, Operational Exam
3. Select Candidate(s) for scoring. Select the candidates for scoring. You can select all candidates or select individual ones by checking the box next to their record.
4. The “Publish” button will appear when candidates are selected. Click “Publish” to publish the selected scores.
5. Optional: In the Candidate Results Report in the Business Intelligence & Reporting Portal, rescored results will appear as if that candidate had completed the live, operational exam.

Contact Us 

 If you have any questions or need additional assistance, please contact us by emailing support@certiverse.com