How calibration activities, the dispute and flagging system work together to ensure the grades you receive in Kritik are high quality

Written by Carine Marette

Updated over a week ago

Overview:

https://youtu.be/TKt-L7fpAv4

1. Grading Power and Calibration Activities

Every student has a "grading power" which is determined by the number of stars around your profile picture. This number changes from activity to activity based on your performance in grading your peers. At the beginning of your course, ideally, your professor will create a calibration activity to identify good evaluators in the course and align student grading with that of the professor. Professors can do this at any time and multiple times during the course to identify good evaluators. Professors and TAs can also adjust any grade using manual grading which will override the grades provided by the peer evaluations. This further calibrates the evaluators' grading power. Those who are identified as good evaluators because their grading is aligned with that of the professor will have more stars around their profile picture, which gives them more weight when evaluating their peers and affects the overall grade more.

https://downloads.intercomcdn.com/i/o/234095272/2b492eb31f2ecbc129a40571/image.png

Once an activity has completed, you will receive a calibration report that will let you know how your grading power has changed after the activity.

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/c48a825c-becf-40be-a900-a783b14380cb/Untitled.png

2. Score Disputes and Flagging Comments

When you dispute your score or flag a comment provided on your creation during the feedback or grading stage, you can bring any issues you find to the attention of your instructor or TA who may then adjust your grade accordingly and remove comments as they see fit. This will in turn further calibrate the grading power of your evaluators. You can dispute your score during the grading stage of your activity.

https://downloads.intercomcdn.com/i/o/234099274/ceda01ba4ca05df73f1b99b0/image.png

You can flag a comment on your creation during the feedback stage of an activity if you feel it is inappropriate.

https://downloads.intercomcdn.com/i/o/234099384/c771854f2205c1907b537ebe/image.png

3. Grading Scheme

Make sure to check your course grading scheme as most instructors allocate a percentage of your course grade to the quality and accuracy of your peer grading. This can be found by clicking on the Course tab on the left navigation bar. To learn more about why your grading skill matters, please check out the article on the Science Behind Kritik.

Untitled