What is Reviewer role in user management?

Know how to set up reviewer roles in user profiles to simplify the process of manual reviewing of assessments.

iMocha has added a new user role - Reviewer under user management. The reviewer role is specifically designed for teams that need to review assessments manually and score them accordingly. A Reviewer is an expert who quantifies the answers to the essay questions - coding questions, translation questions, or any questions where manual evaluation is needed.

How does the reviewer role work?

1. To add a user as a Reviewer:

Super Admin/Admin or Users with user management rights can add a Reviewer. 

1. 1. Log on to your iMocha account.
   2. Click Settings -> Global settings -> Users -> Add User.
      
   3. Enter the email address and full name.
   4. Select Reviewer roles from the listed User roles.
      

You can also assign a Reviewer role to an existing user by editing their access rights. 

2. To enable Manual Evaluation in Test settings:

The test settings must be enabled to assign reports for manual evaluation for a particular test. 

1. 1. Click My Tests, and select the Test you want to edit. 
   2. Select the Test to assign a Reviewer.
   3. Click Settings -> Reviewer Settings.
      
   4. To enable Evaluate Reports Manually, select Yes.
   5. Click Save Test Settings.

3. To assign reports to be evaluated:
When a user is added as a Reviewer, you can assign reports to them for evaluation. Any user with Assign Reviewer access can assign reports to a Reviewer to evaluate.
The assignor also gets access to Generate reports after the designated Reviewers have finished reviewing the reports.
On completion of the Test, the assignor will get an email to assign a reviewer. 

    a.  Click Candidates -> Review Reports.

   b.   Select the Test and click Assign Reviewer.

   c.   In the pop-up, you can view all the users with Reviewer access. You can select one or                         multiple reviewers. The reviewers will get an email notification. 
   d.  The assigned reports will be seen in the Pending for Review tab.

When the Reviewer completes the evaluation, the report will be moved to the 
Review Completed tab.

4.  Evaluation by Reviewer:

The Reviewer will get the report for evaluation.

The Reviewer can then review the report and score the assessment accordingly.

5. Report Generation

The report is generated once all the reviewers complete their evaluation.

The score generated will be based on the average score given by all the reviewers. For any report, it is mandatory that at least one reviewer complete the evaluation.

The report can be viewed under Live Data or All Reports or from the Test itself.

Read Candidate Report to know more.

6. Manage Reviewers

You can re-assign reports or revoke the evaluation access of reviewers. 

        a.  Click Candidates -> Review Reports.

        b.  Click Manage Reviewers.
              From the list of reviewers, you can select reviewers to re-assign reports or revoke the                        access rights. 

 Emails will be sent to the users informing the same.

7.  How will it look for the Reviewers?

When reports are assigned to the Reviewers, they will be informed via email. 
The reports can be seen by the Reviewers under Candidates -> Review Reports ->                    Pending for Review.
The report is moved to the Review Completed tab when the evaluation is complete.

For any queries, mail us at support@imocha.io.