Measuring Performance

Know Road Lingo: Analytics Explained

Before heading off into a new city, you probably will do some research on the vocabulary, the lingo for some. Before we enter the whole new world of Mobius SLIP grading, let us first understand the Analytics. Here is a quick summary of each analytic that you will encounter, for detailed discussion of Analytics see (link to analytics explained page).

Attainment

Attainment is the aggregation of all of the perceptions of a student’s peers within their peer group. In other words, the aggregation of the rankings on the SLIP Slider. This will be a number between 0 and the Desired Peer Group Size; the higher, the better.

Bias

This analytic measures each student’s abilities as an evaluator. In the general sense, did a student agree with the rest of their peers over how well the peer in question did? The number for this statistic range is between 0 and 1 (occasionally, you may see numbers lower than 0 or higher than 1; they should be interpreted as either 0 or 1 respectively). Zero indicates complete convergence of perceptions and evaluations (very high reliability), one – complete divergence (no reliability). A student with high bias may be exceptional or struggling, use your discretion based upon the content of their work.

Controversy

A similar analytic to Bias, but the spotlight turns back to the student as a creator of work. Controversy measures the difference in perceptions among a student’s peers of their work. The numerical output again is between 0 and 1 (with above and below being anomalies which should be rounded back to 0 or 1). Zero indicates that all of a student’s peers converge over the perception of that student’s work. A score of one indicates perceptions being very greatly spread out in perceiving the work. Use your own discretion and analysis of each student’s content.

Self-assessment Inaccuracy

This analytic measures how different the student’s perception of their own work differed from the perceptions of their peers of their work. The scale again is between 0 and 1. Zero meaning perfect convergence and one perfect divergence. If a student has high self-assessment inaccuracy, careful analysis of their work needs to be done. Maybe they are an outperformer or lagging behind the rest of the group.

Total Points

Total points is the weighted sum of the above analytics, Attainment, Bias, Controversy and Self-assessment, minus any penalty that you chose to assign for missing the Reaction phase if Submission was turned in.

Z-score

The z-score is a z-score of the Total Points for each student based on all submitted work for the assignment.

Percentile

The percentile for each student should be understood just like the percentile on a standardized test. A student has whatever percentile they are of students below them.7