The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment

Observation tools have found wide application in ergonomic assessment of musculoskeletal disorders (MSD) because of their ease of use, ability to be used by multiple users with less specialised training and less operation time. However, their major challenge remains the reliability of their findings...

Full description

Bibliographic Details
Main Authors: Rohani, J. M., Adeyemi, A. J., Aziz, R. A., Abdul Rani, M. R.
Format: Article
Language:English
Published: Penerbit UTM Press 2018
Subjects:
Online Access:http://eprints.utm.my/83954/1/JafriMohdRohani2018_TheInterRaterAndIntraRaterReliability.pdf
_version_ 1796863750105464832
author Rohani, J. M.
Adeyemi, A. J.
Aziz, R. A.
Abdul Rani, M. R.
author_facet Rohani, J. M.
Adeyemi, A. J.
Aziz, R. A.
Abdul Rani, M. R.
author_sort Rohani, J. M.
collection ePrints
description Observation tools have found wide application in ergonomic assessment of musculoskeletal disorders (MSD) because of their ease of use, ability to be used by multiple users with less specialised training and less operation time. However, their major challenge remains the reliability of their findings. Since MSD is a multidisciplinary problem, there is need for observation tools to be precise when used by practitioners from different professions. This study therefore, investigated the intra-rater and inter-rater reliability of workplace ergonomic risk assessment (WERA) observation tool. Thirteen ergonomics and safety stakeholders, from four different professions were trained and thereafter, independently asked to carry out risk assessment of ten different videos-captured work activities. WERA was used to evaluate the participants’ exposure to six physical risk factors of MSDs in six body regions, so as to determine their risk level. The assessment was repeated after two weeks. The interclass reliability analysis was carried out using the intraclass correlation coefficient (ICC) with the two-way mixed model and absolute agreement as the preferred types. Two of the tasks, tyre extraction and quay crane operation were rated as high risked with an exposure rating greater than 60%, while the remaining eight were medium-risked. The body regions with high probability of MSD exposure were the neck (70%), leg (60%), wrist (60%) and back (50%). Inter-rater reliability (ICC) of the activities by the professionals ranged between 0.97 and 0.99 while intra-rater reliability of the participants ranged between 0.81 and 1.0. The reliability analysis demonstrated consistency among the different professionals using WERA. Therefore,there is a need to urgently redesign the tasks and carry out ergonomic interventions in the work activities assessed.
first_indexed 2024-03-05T20:31:26Z
format Article
id utm.eprints-83954
institution Universiti Teknologi Malaysia - ePrints
language English
last_indexed 2024-03-05T20:31:26Z
publishDate 2018
publisher Penerbit UTM Press
record_format dspace
spelling utm.eprints-839542019-11-05T04:33:23Z http://eprints.utm.my/83954/ The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment Rohani, J. M. Adeyemi, A. J. Aziz, R. A. Abdul Rani, M. R. TJ Mechanical engineering and machinery Observation tools have found wide application in ergonomic assessment of musculoskeletal disorders (MSD) because of their ease of use, ability to be used by multiple users with less specialised training and less operation time. However, their major challenge remains the reliability of their findings. Since MSD is a multidisciplinary problem, there is need for observation tools to be precise when used by practitioners from different professions. This study therefore, investigated the intra-rater and inter-rater reliability of workplace ergonomic risk assessment (WERA) observation tool. Thirteen ergonomics and safety stakeholders, from four different professions were trained and thereafter, independently asked to carry out risk assessment of ten different videos-captured work activities. WERA was used to evaluate the participants’ exposure to six physical risk factors of MSDs in six body regions, so as to determine their risk level. The assessment was repeated after two weeks. The interclass reliability analysis was carried out using the intraclass correlation coefficient (ICC) with the two-way mixed model and absolute agreement as the preferred types. Two of the tasks, tyre extraction and quay crane operation were rated as high risked with an exposure rating greater than 60%, while the remaining eight were medium-risked. The body regions with high probability of MSD exposure were the neck (70%), leg (60%), wrist (60%) and back (50%). Inter-rater reliability (ICC) of the activities by the professionals ranged between 0.97 and 0.99 while intra-rater reliability of the participants ranged between 0.81 and 1.0. The reliability analysis demonstrated consistency among the different professionals using WERA. Therefore,there is a need to urgently redesign the tasks and carry out ergonomic interventions in the work activities assessed. Penerbit UTM Press 2018-01 Article PeerReviewed application/pdf en http://eprints.utm.my/83954/1/JafriMohdRohani2018_TheInterRaterAndIntraRaterReliability.pdf Rohani, J. M. and Adeyemi, A. J. and Aziz, R. A. and Abdul Rani, M. R. (2018) The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment. Jurnal Teknologi, 80 . pp. 53-59. ISSN 0127-9696 http://dx.doi.org/10.11113/jt.v80.10285 DOI:10.11113/jt.v80.10285
spellingShingle TJ Mechanical engineering and machinery
Rohani, J. M.
Adeyemi, A. J.
Aziz, R. A.
Abdul Rani, M. R.
The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title_full The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title_fullStr The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title_full_unstemmed The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title_short The inter-rater and intra-rater reliability analysis of workplace ergonomic risk assessment
title_sort inter rater and intra rater reliability analysis of workplace ergonomic risk assessment
topic TJ Mechanical engineering and machinery
url http://eprints.utm.my/83954/1/JafriMohdRohani2018_TheInterRaterAndIntraRaterReliability.pdf
work_keys_str_mv AT rohanijm theinterraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT adeyemiaj theinterraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT azizra theinterraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT abdulranimr theinterraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT rohanijm interraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT adeyemiaj interraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT azizra interraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment
AT abdulranimr interraterandintraraterreliabilityanalysisofworkplaceergonomicriskassessment