Development of competency items for vocational teachers using rasch model analysis

Khuzainey Ismail, Zulkifli Mohd Nopiah, Mohamad Sattar Rasul, Pang Chau Leong

Research output: Contribution to journalArticle

Abstract

Competent teachers are valuable assets in the Malaysian Public Skills Training Institutions (MPSTI) for Technical and Vocational Education and Training (TVET) programme. This study aimed to determine the summary statistics for items and persons, fit statistics, and item dimensionality test for the competency items on the vocational teachers at MPSTI using Rasch Model analysis. A total of 222 vocational teachers under the Ministry of Human Resources and Ministry of Youth and Sports participated in the pilot testing. This study collected data from purposive sampling of vocational teachers from seven public skills training institutions in Selangor, Negeri Sembilan, and Kuala Lumpur namely IKTBN Sepang, IKBN Kuala Langat, IKTBN Dusun Tua, IKTBN Chembong, ILP Kuala Lumpur, ILP Kuala Langat, and ADTEC Shah Alam specifically in mechanical, electrical, civil, and computer programme. This study had conducted a pilot test, which covered 180 competency items on technical competency, pedagogy competency and personal competency. The result reveals that the reliability of the item is 0.92, which is high spread with 3.94 separation items. The competency items are divided into four groups; namely difficult items, moderate items, easy items, and very easy items. The overall items are fit except for 40 items that have misfit criteria and they were discarded. The item dimensionality test reveals that the competency items are within the scope of measuring vocational teachers’ competency. The modelled variance is 51.2%, which is considered fair and the unexplained variance in the first contrast is 4.2%, which is considered good. This study contributed to the development of competency items for the vocational teachers in MPTSI using Rasch measurement model. Findings of this study would be significant for TVET management as it provides a basis for a valid instrument in measuring competency of the vocational teachers.

Original languageEnglish
Pages (from-to)51-58
Number of pages8
JournalJournal of Engineering Science and Technology
Volume14
Issue numberSpecial Issue on ICEES2018
Publication statusPublished - 1 Jun 2019

Fingerprint

Inductive logic programming (ILP)
Education
Statistics
Sports
Computer program listings
Personnel
Sampling
Testing

Keywords

  • Competency item
  • Rasch measurement model
  • Vocational teachers

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Development of competency items for vocational teachers using rasch model analysis. / Ismail, Khuzainey; Nopiah, Zulkifli Mohd; Rasul, Mohamad Sattar; Leong, Pang Chau.

In: Journal of Engineering Science and Technology, Vol. 14, No. Special Issue on ICEES2018, 01.06.2019, p. 51-58.

Research output: Contribution to journalArticle

Ismail, K, Nopiah, ZM, Rasul, MS & Leong, PC 2019, 'Development of competency items for vocational teachers using rasch model analysis', Journal of Engineering Science and Technology, vol. 14, no. Special Issue on ICEES2018, pp. 51-58.
Ismail, Khuzainey ; Nopiah, Zulkifli Mohd ; Rasul, Mohamad Sattar ; Leong, Pang Chau. / Development of competency items for vocational teachers using rasch model analysis. In: Journal of Engineering Science and Technology. 2019 ; Vol. 14, No. Special Issue on ICEES2018. pp. 51-58.
@article{10c53c3910fd4f05b5b6c91b20cce90d,
title = "Development of competency items for vocational teachers using rasch model analysis",
abstract = "Competent teachers are valuable assets in the Malaysian Public Skills Training Institutions (MPSTI) for Technical and Vocational Education and Training (TVET) programme. This study aimed to determine the summary statistics for items and persons, fit statistics, and item dimensionality test for the competency items on the vocational teachers at MPSTI using Rasch Model analysis. A total of 222 vocational teachers under the Ministry of Human Resources and Ministry of Youth and Sports participated in the pilot testing. This study collected data from purposive sampling of vocational teachers from seven public skills training institutions in Selangor, Negeri Sembilan, and Kuala Lumpur namely IKTBN Sepang, IKBN Kuala Langat, IKTBN Dusun Tua, IKTBN Chembong, ILP Kuala Lumpur, ILP Kuala Langat, and ADTEC Shah Alam specifically in mechanical, electrical, civil, and computer programme. This study had conducted a pilot test, which covered 180 competency items on technical competency, pedagogy competency and personal competency. The result reveals that the reliability of the item is 0.92, which is high spread with 3.94 separation items. The competency items are divided into four groups; namely difficult items, moderate items, easy items, and very easy items. The overall items are fit except for 40 items that have misfit criteria and they were discarded. The item dimensionality test reveals that the competency items are within the scope of measuring vocational teachers’ competency. The modelled variance is 51.2{\%}, which is considered fair and the unexplained variance in the first contrast is 4.2{\%}, which is considered good. This study contributed to the development of competency items for the vocational teachers in MPTSI using Rasch measurement model. Findings of this study would be significant for TVET management as it provides a basis for a valid instrument in measuring competency of the vocational teachers.",
keywords = "Competency item, Rasch measurement model, Vocational teachers",
author = "Khuzainey Ismail and Nopiah, {Zulkifli Mohd} and Rasul, {Mohamad Sattar} and Leong, {Pang Chau}",
year = "2019",
month = "6",
day = "1",
language = "English",
volume = "14",
pages = "51--58",
journal = "Journal of Engineering Science and Technology",
issn = "1823-4690",
publisher = "Taylor's University College",
number = "Special Issue on ICEES2018",

}

TY - JOUR

T1 - Development of competency items for vocational teachers using rasch model analysis

AU - Ismail, Khuzainey

AU - Nopiah, Zulkifli Mohd

AU - Rasul, Mohamad Sattar

AU - Leong, Pang Chau

PY - 2019/6/1

Y1 - 2019/6/1

N2 - Competent teachers are valuable assets in the Malaysian Public Skills Training Institutions (MPSTI) for Technical and Vocational Education and Training (TVET) programme. This study aimed to determine the summary statistics for items and persons, fit statistics, and item dimensionality test for the competency items on the vocational teachers at MPSTI using Rasch Model analysis. A total of 222 vocational teachers under the Ministry of Human Resources and Ministry of Youth and Sports participated in the pilot testing. This study collected data from purposive sampling of vocational teachers from seven public skills training institutions in Selangor, Negeri Sembilan, and Kuala Lumpur namely IKTBN Sepang, IKBN Kuala Langat, IKTBN Dusun Tua, IKTBN Chembong, ILP Kuala Lumpur, ILP Kuala Langat, and ADTEC Shah Alam specifically in mechanical, electrical, civil, and computer programme. This study had conducted a pilot test, which covered 180 competency items on technical competency, pedagogy competency and personal competency. The result reveals that the reliability of the item is 0.92, which is high spread with 3.94 separation items. The competency items are divided into four groups; namely difficult items, moderate items, easy items, and very easy items. The overall items are fit except for 40 items that have misfit criteria and they were discarded. The item dimensionality test reveals that the competency items are within the scope of measuring vocational teachers’ competency. The modelled variance is 51.2%, which is considered fair and the unexplained variance in the first contrast is 4.2%, which is considered good. This study contributed to the development of competency items for the vocational teachers in MPTSI using Rasch measurement model. Findings of this study would be significant for TVET management as it provides a basis for a valid instrument in measuring competency of the vocational teachers.

AB - Competent teachers are valuable assets in the Malaysian Public Skills Training Institutions (MPSTI) for Technical and Vocational Education and Training (TVET) programme. This study aimed to determine the summary statistics for items and persons, fit statistics, and item dimensionality test for the competency items on the vocational teachers at MPSTI using Rasch Model analysis. A total of 222 vocational teachers under the Ministry of Human Resources and Ministry of Youth and Sports participated in the pilot testing. This study collected data from purposive sampling of vocational teachers from seven public skills training institutions in Selangor, Negeri Sembilan, and Kuala Lumpur namely IKTBN Sepang, IKBN Kuala Langat, IKTBN Dusun Tua, IKTBN Chembong, ILP Kuala Lumpur, ILP Kuala Langat, and ADTEC Shah Alam specifically in mechanical, electrical, civil, and computer programme. This study had conducted a pilot test, which covered 180 competency items on technical competency, pedagogy competency and personal competency. The result reveals that the reliability of the item is 0.92, which is high spread with 3.94 separation items. The competency items are divided into four groups; namely difficult items, moderate items, easy items, and very easy items. The overall items are fit except for 40 items that have misfit criteria and they were discarded. The item dimensionality test reveals that the competency items are within the scope of measuring vocational teachers’ competency. The modelled variance is 51.2%, which is considered fair and the unexplained variance in the first contrast is 4.2%, which is considered good. This study contributed to the development of competency items for the vocational teachers in MPTSI using Rasch measurement model. Findings of this study would be significant for TVET management as it provides a basis for a valid instrument in measuring competency of the vocational teachers.

KW - Competency item

KW - Rasch measurement model

KW - Vocational teachers

UR - http://www.scopus.com/inward/record.url?scp=85069173069&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069173069&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:85069173069

VL - 14

SP - 51

EP - 58

JO - Journal of Engineering Science and Technology

JF - Journal of Engineering Science and Technology

SN - 1823-4690

IS - Special Issue on ICEES2018

ER -