Question Insights help in analyzing the test composition highlighting the key metrics for each question. This can then be further used to modify the test composition.
After a test is created and rolled out to the test-takers, test admins often analyze the results to understand if the test is well-balanced with the apt questions and proportionate time allotted. One of the ways to analyze this is Question Insights.
Question Insights help the test creators to analyze how their selected question has performed with the candidates. E.g., if you have marked a question with medium difficulty and the actual analysis reveals the difficulty level as hard, the question needs to be changed.
How to view Questions Insights
1. Log in to your iMocha account
2. Select the test you want to view insights for
3. Click Question Insights
All the questions used in the test will be displayed along with their analysis.
All questions with 10+ attempts will have a Difficulty Index generated. This index will indicate how the candidates have attempted a question with a particular assigned difficulty level and the actual difficulty index.
In the image below, you can see the assigned difficulty level is Medium, whereas, after the candidate attempts, the actual difficulty index falls under the easy category.
4. Click on View to know the analysis for the question
The percentage in the blocks is that of the number of questions in each level as per DI divided by total questions in the grid.
How will this help?
Question Insights is exclusive analytics provided at a granular level to know the candidates' performance for each question. Comparing the assigned difficulty level to the question versus the difficulty Index obtained by ML algorithms run over a wide data set of candidates' test attempt gives a clear picture of difficulty for a single test.
This analytics helps in analyzing the sourcing as well as the performance for every question asked.
For any queries on the question, insights write to us at firstname.lastname@example.org