New methods introduced into certification processes

In the current draft of ISO 9712:2021, psychometrics has been introduced into the certification processes. What is that, I hear you say? Will it involve men in white coats asking unusual questions? Well, thankfully, no white coats or mental health-related questions. The psychometrics process is defined as a statistical process to verify that qualification/certification examinations are fair, reliable and discriminate between a competent and non-competent individual. The process, as proposed, is titled ‘Psychometric principles’ and the following directions have been included:
If the certification body chooses to use psychometric principles for the written examinations, then the following shall be required:
  • Any reference to questions in this standard relates to scorable questions; however, all questions (scorable and non-scorable) shall be considered when calculating examination times.
  • Scorable questions are approved and validated test items submitted to the Certification Body (or Authorised Qualification Body (AQB)) for entry into the item bank. Non-scorable questions (not used to determine pass/fail) are items developed and approved for use on future examinations but are not statistically validated. Validation requires a minimum number of exposures and item analysis as defined by the certification body before use as a scorable question.
  • The minimum passing grade shall be 70%.
  • The grading of examinations shall be done in accordance with the psychometric process defined by the certification body.

It is a process that, if adopted by the certification body (PCN), will, on some occasions, increase the number of questions on a paper with not all of them counting for the overall score. I can see both merit in trialling questions under examination conditions and demerit in having a paper with more questions than the candidate was expecting and different time limits for the papers with extra questions.

On another topic, whilst at an approved training organisation (ATO)/AQB, the subject of calibration was discussed and what that exactly entails. The term ‘calibration’ can be used for two different activities: one relates to the equipment being checked against nationally traceable standards by the manufacturer or other appropriate agent; and the second where the tester, as an example, performs the task of setting the time base to an appropriate range on an ultrasonic set along with the signal amplitude.

The discussion ranged around the concept that the term ‘calibration’ should only be applied to the first activity but not to the second activity. The issue then became how to term the activities that the testers undertake if ‘calibration’ is not to be used. No viable alternatives were settled on. If you have any thoughts on this, send your suggestions to me at: john.moody@bindt.org

Another point of potential discussion is whether PCN issues qualifications or certificates, or a combination of both.

Comments by members

This forum post has no comments, be the first to leave a comment.

Submit your comment

You need to log in to submit a Comment. Please click here to log in or register.

<< Back