Sometimes it is desirable to adjust the pass score of a test afterwards. This can be for various reasons, for example because a test turned out to be too difficult (or too easy).
In Remindo, a pass mark is always set prior to a test in the test manager environment. This can be found under Keys > select the specific key > Settings tab. See also the articles blueprint Settings, Normal Caesura and Composite Caesura.
This is an absolute cut-off point, because the test scores are determined independently of the level of a group of candidates. The criterion consists of a percentage of the maximum points that can be obtained for a pass. It is possible to adjust the cut-off point in the test environment, but only if it has been indicated in the test managemer that the cut-off point may be adjusted in the test player environment. This can also be done via blueprints > select the specific test > Settings tab.
Adjust caesura of a test moment
In the test player, the absolute cut-off point can be adjusted for a test moment via Planning > Test moments tab > Edit test moment settings. Then click on 'Change these settings' under blueprint settings. Here the percentage of the pass mark, the type of score and a possible guess correction can be adjusted.
Adjusting the pass mark of registrations
In addition, the absolute pass mark of (a selection of) registrations can also be adjusted. To do this, go to Results > Analyses, find the blueprint and select the relevant candidates. Then choose the action 'Change registrations'. Under blueprint settings, choose 'Change these settings' to be able to adjust the pass mark. When this option is selected, the pass mark will only be changed for the relevant candidates (registrations) and not for candidates who have not been selected or who later take a test based on this test matrix.
Cohen-Schotanus method
If the absolute cut-off point has to be corrected on the basis of group performance, the Cohen-Schotanus method can be chosen in the test environment. This is a compromise method between absolute and relative standardization. By applying this method, account is taken of how the group has scored (relative norming) without completely abandoning the absolute norming.
In Remindo, two options can be chosen to apply the Cohen-Schotanus method. For both applications, a 100% score is always required for the highest possible result; only the points within the cut-off line are adjusted according to the chosen method.
- The first option shown, P95, means that the result at the 95th percentile is taken into account in the adjustment of the cut score.
- The second option, average of the top 5%, calculates the average of the top 5% results and adjusts the cut-off line accordingly.
Note!
With the Cohen-Schotanus method, the score of a candidate partly depends on the score of the group. A reliable result is desired, so it is important that the scores are representative of what to expect. is expected from the target group, which means that the method can only be applied when there is a large group of candidates (keep a minimum of 50 candidates
For more information about the background of the Cohen-Schotanus method, see the article: Janke Cohen-Schotanus & Cees P. M. van der Vleuten (2010) A standard setting method with the best performing students as point of reference: Practical and affordable, Medical Teacher, 32:2, 154-160, DOI: 10.3109/01421590903196979
Disclaimer: This text was automatically translated from the Dutch version.