Questionmark OnDemand

Setting the appropriate Assessment Cut Score

Introduction

Here are some questions to help check your understanding on setting an appropriate cut score (pass/fail score). You will be scored +1 for getting a question right, -1 for getting it wrong and 0 for not knowing or leaving unanswered.

You are involved in the setting of a diagnostic test around safety procedures on a large production line and, having recently finished trialling the questions, you are considering where to set the cut score. You have access to the data set from the trialling that was administered to a random selected sample of those who currently work the line.

Given this information which of the following statements are correct:


Question

If this test was randomised the cut score could be set at least slightly lower 

Question

There are a number of different methods you could use and set a valid cut score for this test

Question

It would be better to set multiple cut scores than a single cut score

Question

If a quarter of the workers had English as 2nd language and this group had a below average score in the trialling, then the cut score should be set proportionally lower for the other non-native speakers

Question

A criterion-referenced cut score would be more valid for this test than a norm-referenced cut score