Inter-rater Observational Workflow using Data Viewer

Inter-rater Observation can be performed by an Admin or Group System Admin viewing two scorer’s annotations on the same client video.

Inter-rater Observation can also be done by using the Tag or Keword reports. Click here to see how.

1. Create two Scorer roles.
   

   Set “Scorer” as the role when creating a new user.

2. Associate a Client or Login Client to that Scorer Role.”Scorer assign Keywords and/or Tags to the video. (Scorer role is blinded to other scorer annotations)
   

   Associate Client to both Scorers

3. Scorer adds tags and keywords to the video in the Client’s folder.
   

   Scorer adds annotations to client video.

4. Admin logs into the system and reviews the annotations.
   

   Admin opens Client video and see both scorers annotations.

5. Admin can see the discrepancy or similarity of annotations applied to the same evidence.