1. Help Center | iMocha
  2. Managing Users & Role - Based Access Control

What is Reviewer role in user management?

Know how to set up reviewer roles in user profiles to simplify the process of manual reviewing of assessments.

iMocha has added a new user role - Reviewer under user management. The reviewer role is specifically designed for teams that need to review assessments manually and score them accordingly. A Reviewer is an expert who quantifies the answers to the essay questions - coding questions, translation questions, or any questions where manual evaluation is needed.

HubSpot Video

How does the reviewer role work?

1. To add a user as a Reviewer:

Super Admin/Admin or Users with user management rights can add a Reviewer. 

    1. Log on to your iMocha account.
    2. Click Settings -> Global settings -> Users -> Add User.
      add user
    3. Enter the email address and full name.
    4. Select Reviewer roles from the listed User roles.
      reviewer access

Note: Reviewer gets default access rights to View Report, View Questions, and Review Report. 

You can also assign a Reviewer role to an existing user by editing their access rights. 

2. To enable Manual Evaluation in Test settings:

The test settings must be enabled to assign reports for manual evaluation for a particular test. 

    1. Click My Tests, and select the Test you want to edit. 
    2. Select the Test to assign a Reviewer.
    3. Click Settings -> Reviewer Settings.
      reviewer settings
    4. To enable Evaluate Reports Manually, select Yes.
    5. Click Save Test Settings.

Note:  Ensure this setting is enabled to assign the Reports to a Reviewer.

3. To assign reports to be evaluated:
When a user is added as a Reviewer, you can assign reports to them for evaluation. Any user with Assign Reviewer access can assign reports to a Reviewer to evaluate.
The assignor also gets access to Generate reports after the designated Reviewers have finished reviewing the reports.
On completion of the Test, the assignor will get an email to assign a reviewer. 

    a.  Click Candidates -> Review Reports.

Review reports tab

   b.   Select the Test and click Assign Reviewer.

assign reviewer

   c.   In the pop-up, you can view all the users with Reviewer access. You can select one or                         multiple reviewers. The reviewers will get an email notification. 
   d.  The assigned reports will be seen in the Pending for Review tab.

When the Reviewer completes the evaluation, the report will be moved to the 
Review Completed tab.

4.  Evaluation by Reviewer:

The Reviewer will get the report for evaluation.

report pending for review

Note: The Reviewer will not see the candidate's name; instead, it will be the candidate's ID.

The Reviewer can then review the report and score the assessment accordingly.

Review report

5. Report Generation

The report is generated once all the reviewers complete their evaluation.

The score generated will be based on the average score given by all the reviewers. For any report, it is mandatory that at least one reviewer complete the evaluation.

The report can be viewed under Live Data or All Reports or from the Test itself.

Read Candidate Report to know more.

6. Manage Reviewers

You can re-assign reports or revoke the evaluation access of reviewers. 

        a.  Click Candidates -> Review Reports.

        b.  Click Manage Reviewers.
              From the list of reviewers, you can select reviewers to re-assign reports or revoke the                        access rights. 

 Emails will be sent to the users informing the same.

7.  How will it look for the Reviewers?

When reports are assigned to the Reviewers, they will be informed via email. 
The reports can be seen by the Reviewers under Candidates -> Review Reports ->                    Pending for Review.
The report is moved to the Review Completed tab when the evaluation is complete.

Note: The report cannot be modified once you click Finish Review. 

For any queries, mail us at support@imocha.io.