Use of rasch analysis to measure students performance in engineering education

M. Saidfudin, A. A. Azrilah, N. A. Rodzo'An, Mohd. Zaidi Omar, Azami Zaharim, Hassan Basri

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The Engineering Accreditation Council of Malaysia (EAC) adopts the American Accreditation Board of Engineering and Technology 2000 (ABET) requirements which promote outcome based education (OBE) learning process. OBE calls for the evaluation of the subjects learning outcomes (LO) as specified in the Programme Specification. This good practice is implemented in the Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia (UKM) teaching and learning processes. Evaluation method has been largely dependent on students' performance carrying out tasks such as tests, quizzes or submission of assignments. Instrument construct were based on Bloom's Taxonomy whilst the evaluation on the students performance output were assessed based on Students Observed Learning Outcomes (SOLO) Taxonomy which gives an indication on the student's achievement of the subject expected LO. However, the measurement of the student's achievement from the observed outcomes remain vague. This paper describes a measurement model using Rasch Analysis which can be used to measure the subject LO of an undergraduate engineering subject. An overview of the measurement model and its key concepts are presented and illustrated using the final exam paper given through subject KKKF1134 - Introduction to Engineering. Results obtained were assessed against the course LO maps for consistency and used as a guide for future improvement of the teaching method and style. The study shows that Rasch model of measurement can classify grades into learning outcomes more accurately especially in dealing with small number of sampling unit.

Original languageEnglish
Title of host publicationInternational Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings
Pages435-441
Number of pages7
Publication statusPublished - 2010
Event7th WSEAS International Conference on Engineering Education, EDUCATION'10, International Conference on Education and Educational Technologies - Corfu Island
Duration: 22 Jul 201024 Jul 2010

Other

Other7th WSEAS International Conference on Engineering Education, EDUCATION'10, International Conference on Education and Educational Technologies
CityCorfu Island
Period22/7/1024/7/10

Fingerprint

engineering
learning
performance
education
student
accreditation
taxonomy
Malaysia
learning process
evaluation
teaching style
quiz
teaching method
best practice
indication
Teaching

Keywords

  • Continuous improvement
  • Instructional objectives
  • Learning outcomes
  • Performance assessment
  • Quality

ASJC Scopus subject areas

  • Education

Cite this

Saidfudin, M., Azrilah, A. A., Rodzo'An, N. A., Omar, M. Z., Zaharim, A., & Basri, H. (2010). Use of rasch analysis to measure students performance in engineering education. In International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings (pp. 435-441)

Use of rasch analysis to measure students performance in engineering education. / Saidfudin, M.; Azrilah, A. A.; Rodzo'An, N. A.; Omar, Mohd. Zaidi; Zaharim, Azami; Basri, Hassan.

International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings. 2010. p. 435-441.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Saidfudin, M, Azrilah, AA, Rodzo'An, NA, Omar, MZ, Zaharim, A & Basri, H 2010, Use of rasch analysis to measure students performance in engineering education. in International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings. pp. 435-441, 7th WSEAS International Conference on Engineering Education, EDUCATION'10, International Conference on Education and Educational Technologies, Corfu Island, 22/7/10.
Saidfudin M, Azrilah AA, Rodzo'An NA, Omar MZ, Zaharim A, Basri H. Use of rasch analysis to measure students performance in engineering education. In International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings. 2010. p. 435-441
Saidfudin, M. ; Azrilah, A. A. ; Rodzo'An, N. A. ; Omar, Mohd. Zaidi ; Zaharim, Azami ; Basri, Hassan. / Use of rasch analysis to measure students performance in engineering education. International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings. 2010. pp. 435-441
@inproceedings{c48c12a19142440b911348cd6cbd1360,
title = "Use of rasch analysis to measure students performance in engineering education",
abstract = "The Engineering Accreditation Council of Malaysia (EAC) adopts the American Accreditation Board of Engineering and Technology 2000 (ABET) requirements which promote outcome based education (OBE) learning process. OBE calls for the evaluation of the subjects learning outcomes (LO) as specified in the Programme Specification. This good practice is implemented in the Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia (UKM) teaching and learning processes. Evaluation method has been largely dependent on students' performance carrying out tasks such as tests, quizzes or submission of assignments. Instrument construct were based on Bloom's Taxonomy whilst the evaluation on the students performance output were assessed based on Students Observed Learning Outcomes (SOLO) Taxonomy which gives an indication on the student's achievement of the subject expected LO. However, the measurement of the student's achievement from the observed outcomes remain vague. This paper describes a measurement model using Rasch Analysis which can be used to measure the subject LO of an undergraduate engineering subject. An overview of the measurement model and its key concepts are presented and illustrated using the final exam paper given through subject KKKF1134 - Introduction to Engineering. Results obtained were assessed against the course LO maps for consistency and used as a guide for future improvement of the teaching method and style. The study shows that Rasch model of measurement can classify grades into learning outcomes more accurately especially in dealing with small number of sampling unit.",
keywords = "Continuous improvement, Instructional objectives, Learning outcomes, Performance assessment, Quality",
author = "M. Saidfudin and Azrilah, {A. A.} and Rodzo'An, {N. A.} and Omar, {Mohd. Zaidi} and Azami Zaharim and Hassan Basri",
year = "2010",
language = "English",
isbn = "9789604742028",
pages = "435--441",
booktitle = "International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings",

}

TY - GEN

T1 - Use of rasch analysis to measure students performance in engineering education

AU - Saidfudin, M.

AU - Azrilah, A. A.

AU - Rodzo'An, N. A.

AU - Omar, Mohd. Zaidi

AU - Zaharim, Azami

AU - Basri, Hassan

PY - 2010

Y1 - 2010

N2 - The Engineering Accreditation Council of Malaysia (EAC) adopts the American Accreditation Board of Engineering and Technology 2000 (ABET) requirements which promote outcome based education (OBE) learning process. OBE calls for the evaluation of the subjects learning outcomes (LO) as specified in the Programme Specification. This good practice is implemented in the Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia (UKM) teaching and learning processes. Evaluation method has been largely dependent on students' performance carrying out tasks such as tests, quizzes or submission of assignments. Instrument construct were based on Bloom's Taxonomy whilst the evaluation on the students performance output were assessed based on Students Observed Learning Outcomes (SOLO) Taxonomy which gives an indication on the student's achievement of the subject expected LO. However, the measurement of the student's achievement from the observed outcomes remain vague. This paper describes a measurement model using Rasch Analysis which can be used to measure the subject LO of an undergraduate engineering subject. An overview of the measurement model and its key concepts are presented and illustrated using the final exam paper given through subject KKKF1134 - Introduction to Engineering. Results obtained were assessed against the course LO maps for consistency and used as a guide for future improvement of the teaching method and style. The study shows that Rasch model of measurement can classify grades into learning outcomes more accurately especially in dealing with small number of sampling unit.

AB - The Engineering Accreditation Council of Malaysia (EAC) adopts the American Accreditation Board of Engineering and Technology 2000 (ABET) requirements which promote outcome based education (OBE) learning process. OBE calls for the evaluation of the subjects learning outcomes (LO) as specified in the Programme Specification. This good practice is implemented in the Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia (UKM) teaching and learning processes. Evaluation method has been largely dependent on students' performance carrying out tasks such as tests, quizzes or submission of assignments. Instrument construct were based on Bloom's Taxonomy whilst the evaluation on the students performance output were assessed based on Students Observed Learning Outcomes (SOLO) Taxonomy which gives an indication on the student's achievement of the subject expected LO. However, the measurement of the student's achievement from the observed outcomes remain vague. This paper describes a measurement model using Rasch Analysis which can be used to measure the subject LO of an undergraduate engineering subject. An overview of the measurement model and its key concepts are presented and illustrated using the final exam paper given through subject KKKF1134 - Introduction to Engineering. Results obtained were assessed against the course LO maps for consistency and used as a guide for future improvement of the teaching method and style. The study shows that Rasch model of measurement can classify grades into learning outcomes more accurately especially in dealing with small number of sampling unit.

KW - Continuous improvement

KW - Instructional objectives

KW - Learning outcomes

KW - Performance assessment

KW - Quality

UR - http://www.scopus.com/inward/record.url?scp=79958761974&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79958761974&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:79958761974

SN - 9789604742028

SP - 435

EP - 441

BT - International Conference on Engineering Education and International Conference on Education and Educational Technologies - Proceedings

ER -