Subject Matter Expert (SME) Target Numbers by Task

To ensure the successful execution of various tasks in our project, it is crucial to engage an appropriate number of Subject Matter Experts (SMEs) for each task.

Below are the recommended target numbers for SMEs by task: 

1. Job Task Analysis - Elicitation of Tasks: 

  • Target Group Size: 3-5 individuals 
  • Description: For task elicitation, a smaller group of highly focused individuals is preferred. This allows for detailed and in-depth discussions, ensuring a comprehensive understanding of the tasks.
2. Job Task Analysis -  Survey:
  • Target Group Size: 30 or more individuals 
  • Description: Conducting surveys requires a larger group to obtain representative and statistically significant data. Engaging over 30 individuals ensures diversity and reliability in the survey results.
3. Writing Items:
  • Target Group Size: Ideally 12 individuals, but at least 3 
  • Description: While an exam could technically be written by a single SME, it is much better to have at least 3 SMEs to ensure a variety of perspectives and comprehensive coverage of the content. Having more SMEs, ideally around 12, increases efficiency and the quality of the items produced.
4. Beta Testing:
  • Target Group Size: 50 or more individuals 
  • Description: For beta testing, involving 50 or more testers is ideal to thoroughly evaluate the items. It is essential that these testers are not the same SMEs who assisted in writing or reviewing the questions to ensure unbiased feedback. However, beta testing can still proceed with fewer testers if necessary.
5. Standard Setting:
  • Target Group Size: 6-12 individuals 
  • Description: Setting the passing standard should ideally involve a representative sample of six SMEs, with more being better. This ensures a well-rounded and comprehensive review process, adhering to quality standards and maintaining objectivity. 

Engaging the right number of SMEs in each task is critical for the quality and success of the project. These recommendations provide a balanced approach to ensure thoroughness, efficiency, and representative feedback. 

 

Contact Us

If you have any questions or need additional assistance, please contact us by either emailing support@certiverse.com or by submitting a ticket from this article.