Inter-rater Agreement Based Risk Assessment Scheme for ICT Corporates

An ISO 9001 audit can be seen as an independent risk assessment of the business, where each ‘Nonconformity” or “Opportunity For Improvement” is considered a potential risk. Nevertheless, their actual impact on the business remains difficult to determine; as a consequence, the urgency of a mitigation plan at the corporate level can sometimes be underestimated. This paper proposes a semi-quantitative risk assessment methodology on the ISO 9001 findings relying on a selected panel of experts. The experts’ responses are analyzed and validated using a specific statistics test for inter-rater reliability. The proposed methodology has been applied to real findings coming from ISO 9001 internal audits, involving 10 subject matter experts from 7 different countries.