Ensuring that Evaluators can Evaluate the Agents Group

Before calibrating evaluators, ensure that the evaluators are assigned the right to evaluate the group that the target agent is in.

Find each evaluator in the User Manager section, open their profile, and check if the groups have been assigned to them. 

  1. Select User Manager from the menu tree. The User Manager tab opens.
  2. Select an evaluator. In the figure above, this is a supervisor. Other roles may perform the evaluation if they have the appropriate permissions.
  3. Click edit  Add or  Edit User. The dialog box opens for this evaluator.
  4. Drag the group into the Groups Assigned to Supervisor field.
  5. Click Save.

Repeat steps 2 to 5 for each evaluator.

Selecting a Suitable Evaluation for Calibration

Find a suitable evaluation for calibration by navigating to the Evaluation List. The Evaluation List tab opens and displays the most recent evaluations. Use the page controls at the bottom of the window to find Finished evaluations.

Select the checkbox of an evaluation with the status Finished as the basis of the calibration.

  1. Click More Actions.
  2. Select Re-Evaluate.
    The Evaluation Planner tab opens populated with the same interactions and parameters as the original evaluation. The Remove Interactions dialog box opens.
     
  3. Click No, this ensures that the same interaction is used for each evaluation.
  4. Select an evaluator to participate in the calibration session.
  5. The Do you wish to remove all interactions? prompt appears again.
  6. Click No
  7. Find the group which the agent is a member of, select it, and then the agents who are members of this group will appear in the Agents box. Select the correct agent using the check box on the left. The Do you wish to remove all interactions? prompt will appear.

  8. Click No on the prompt box.
  9. Click Create Evaluations. The evaluations created dialog displays.
  10. Click OK. The evaluation is created.

Repeat steps 1 to 7 for each evaluator.

The newly created evaluations should now display in the Evaluation List with the most recent displaying at the top of the first page.

The Parent ID denotes the original evaluation that the new evaluation is based on. This is useful for comparison purposes with the original.

The evaluators must all evaluate the same agent and interactions. Once all of the evaluations are completed, Quality Manager can generate reports to compare results.

The easiest way to compare evaluators in detail, is to find the Finished evaluations in the Evaluation List, select each evaluation, and click Report. The evaluators can then compare scores .


You may also wish to use compare scores.