What is Reviewer role in user management?

Know how to set up reviewer roles in user profiles to simplify the process of manual reviewing of assessments.

The reviewer role is specifically designed for teams that need to review assessments manually and score them accordingly. A Reviewer is an expert who quantifies the answers to the essay questions - coding questions, translation questions, or any questions where manual evaluation is needed.

How does the reviewer role work?

To add a user as a Reviewer:

Super Admin/Admin or Users with user management rights can add a Reviewer. 

Follow the below steps to add a user as a reviewer:

1. Go to Settings -> Global settings -> Users -> Add User.
   
2. Enter the email address and full name.
3. Select Reviewer roles from the listed User roles.

You can also assign a Reviewer role to an existing user by editing their access rights. 

To remind users to add Reviewer:

Ensuring to enable the reviewer functionality is crucial for properly assessing, scoring, and reviewing candidates' responses to manually evaluated questions. We, as humans, sometimes miss this important step. To address this, iMocha has introduced the reminder option. This reminder helps users remember to add a reviewer once they try to publish a test.

Follow the below steps to enable the reminder setting:

1. Go to  Global Settings-> Master Settings Test-> Reviewer Settings
2. Enable the Reminder to add reviewers option.
   
3. After enabling this option, every time a sub-user creates and attempts to publish a test, a reminder pop-up window appears as shown below: 
   
   In case the user wants to add the reviewer, they can click the link provided in the pop-up window and get redirected to the reviewer settings page.

To enable Manual Evaluation in Test settings:

The test settings must be enabled to assign reports for manual evaluation for a particular test. 

Follow the below steps to enable manual evaluation in Test settings:

1. Go to My Tests.
2. Select the Test you want to edit.
3. Select the Test to assign a Reviewer.
4. Click Settings -> Reviewer Settings.
5. To enable Evaluate Reports Manually, select Yes.
6. Click Save Test Settings.

To assign reports to be evaluated:

When a user is added as a Reviewer, you can assign reports to them for evaluation. any user with Assign Reviewer access can assign reports to a Reviewer to evaluate.
The assignor also gets access to Generate reports after the designated Reviewers have finished reviewing the reports.
On completion of the Test, the assignor will get an email to assign a reviewer. 

The assignor has to log on to their iMocha account and follow the below steps:

1. Click Candidates -> Review Reports.
   
2. Select the Test.
3. Click Assign Reviewer.
   
   In the pop-up, you can view all the users with Reviewer access. You can select one or                multiple reviewers. The reviewers will get an email notification.
   The assigned reports will be seen in the Pending for Review tab.

When the Reviewer completes the evaluation, the report will be moved to the Review Completed tab.

How the Reviewer evaluate the report?

When reports are assigned to the Reviewers, they will be informed through an email notification. 

The email notification appears as shown below:

The reviewers can view the reports assigned to them for evaluation listed on the Pending for Review tab.

Once the reviewer log on to their iMocha account and they will be directly taken to the Pending for Review tab on the Review Reports page as shown below: :

1. In the Candidate-> Review Report->Pending for Review tab, you can view the list of reports assigned to you.
2. Select the report to review and click Review Report.
   
   

The Reviewer can then review the report and score the assessment accordingly.

The Reviewers have to make sure that the scores entered by them are saved for each question, by clicking outside the text box and ensuring that the confirmation message   appears as shown in the above image. Once they complete scoring of all the questions, and click Finish Review, the report will be moved to the Review Completed tab.

Report Generation:

The report is generated once all the reviewers complete their evaluation.

The score generated will be based on the average score given by all the reviewers. For any report, it is mandatory that at least one reviewer complete the evaluation.

The report can be viewed under Live Data or All Reports or from the Test itself.

Read Candidate Report to know more.

How to Manage Reviewers?

You can re-assign reports or revoke the evaluation access of reviewers. 

1. Go to Candidates -> Review Reports.
2. Select Manage Reviewers.

From the list of reviewers, you can select reviewers to re-assign reports or revoke the                        access rights.

Emails will be sent to the users informing the same.

For any queries, mail us at support@imocha.io.