Validity and reliability of the clinical competency evaluation instrument for use among physiotherapy students: Pilot study

Zailani Muhamad, Ayiesah Ramli, Salleh Amat

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Objectives: The aim of this study was to determine the content validity, internal consistency, testretest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. Methods: This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students’ clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument’s reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. Results: The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83–1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach’s alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson’s correlation range of 0.91–0.97 and an intraclass coefficient correlation range of 0.95–0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. Conclusion: This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Original languageEnglish
Pages (from-to)e266-e274
JournalSultan Qaboos University Medical Journal
Volume15
Issue number2
Publication statusPublished - 1 May 2015

Fingerprint

Clinical Competence
Reproducibility of Results
Students
Malaysia
Documentation
Cross-Sectional Studies
Safety

Keywords

  • Clinical competence
  • Malaysia
  • Physiotherapy speciality
  • Validity and reliability

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Validity and reliability of the clinical competency evaluation instrument for use among physiotherapy students : Pilot study. / Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh.

In: Sultan Qaboos University Medical Journal, Vol. 15, No. 2, 01.05.2015, p. e266-e274.

Research output: Contribution to journalArticle

@article{6c285651d32b4258b61887c1c9e5b801,
title = "Validity and reliability of the clinical competency evaluation instrument for use among physiotherapy students: Pilot study",
abstract = "Objectives: The aim of this study was to determine the content validity, internal consistency, testretest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. Methods: This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students’ clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument’s reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. Results: The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83–1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach’s alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson’s correlation range of 0.91–0.97 and an intraclass coefficient correlation range of 0.95–0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. Conclusion: This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.",
keywords = "Clinical competence, Malaysia, Physiotherapy speciality, Validity and reliability",
author = "Zailani Muhamad and Ayiesah Ramli and Salleh Amat",
year = "2015",
month = "5",
day = "1",
language = "English",
volume = "15",
pages = "e266--e274",
journal = "Sultan Qaboos University Medical Journal",
issn = "2075-051X",
publisher = "Sultan Qaboos University",
number = "2",

}

TY - JOUR

T1 - Validity and reliability of the clinical competency evaluation instrument for use among physiotherapy students

T2 - Pilot study

AU - Muhamad, Zailani

AU - Ramli, Ayiesah

AU - Amat, Salleh

PY - 2015/5/1

Y1 - 2015/5/1

N2 - Objectives: The aim of this study was to determine the content validity, internal consistency, testretest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. Methods: This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students’ clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument’s reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. Results: The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83–1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach’s alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson’s correlation range of 0.91–0.97 and an intraclass coefficient correlation range of 0.95–0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. Conclusion: This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

AB - Objectives: The aim of this study was to determine the content validity, internal consistency, testretest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. Methods: This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students’ clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument’s reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. Results: The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83–1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach’s alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson’s correlation range of 0.91–0.97 and an intraclass coefficient correlation range of 0.95–0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. Conclusion: This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

KW - Clinical competence

KW - Malaysia

KW - Physiotherapy speciality

KW - Validity and reliability

UR - http://www.scopus.com/inward/record.url?scp=84930066534&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930066534&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84930066534

VL - 15

SP - e266-e274

JO - Sultan Qaboos University Medical Journal

JF - Sultan Qaboos University Medical Journal

SN - 2075-051X

IS - 2

ER -