Rasch model analysis on the effectiveness of early evaluation questions as a benchmark for new students ability

Research output: Contribution to journalArticle

Abstract

This paper discusses the effectiveness of the early evaluation questions conducted to determine the academic ability of the new students in the Department of Electrical, Electronics and Systems Engineering. Questions designed are knowledge based-on what the students have learned during their pre-university level. The results show students have weak basic knowledge and this is in contrast to the results obtained during the application for admission to Year 1 of university. Thus, early evaluation questions were implemented to see the relevance in assessing the student's ability, obtained by the use of Rasch analysis, WinSteps. The findings show that the initial assessment is an effective and appropriate method to assess the ability of students, where the Cronbach-a is 0.69 and achieve the acceptable ranges of PT-Measure, Mean Square Outfit or Outfit Mean Square (MNSQ) and z-standardized values ??ZSTD) Outfit. This shows that Rasch analysis can be used to classify the questions and the students according to their performance level accurately and thus, reveal the true level of the students" ability, despite the small number of samples.

Original languageEnglish
Pages (from-to)185-190
Number of pages6
JournalInternational Education Studies
Volume6
Issue number6
DOIs
Publication statusPublished - 2013

Fingerprint

model analysis
ability
evaluation
student
systems engineering
university
electronics
knowledge
performance
Values

Keywords

  • Bloom taxonomy
  • Early evaluation questions
  • New students
  • Rasch analysis

ASJC Scopus subject areas

  • Education

Cite this

@article{213a75714c6347b18074ef72879177b5,
title = "Rasch model analysis on the effectiveness of early evaluation questions as a benchmark for new students ability",
abstract = "This paper discusses the effectiveness of the early evaluation questions conducted to determine the academic ability of the new students in the Department of Electrical, Electronics and Systems Engineering. Questions designed are knowledge based-on what the students have learned during their pre-university level. The results show students have weak basic knowledge and this is in contrast to the results obtained during the application for admission to Year 1 of university. Thus, early evaluation questions were implemented to see the relevance in assessing the student's ability, obtained by the use of Rasch analysis, WinSteps. The findings show that the initial assessment is an effective and appropriate method to assess the ability of students, where the Cronbach-a is 0.69 and achieve the acceptable ranges of PT-Measure, Mean Square Outfit or Outfit Mean Square (MNSQ) and z-standardized values ??ZSTD) Outfit. This shows that Rasch analysis can be used to classify the questions and the students according to their performance level accurately and thus, reveal the true level of the students{"} ability, despite the small number of samples.",
keywords = "Bloom taxonomy, Early evaluation questions, New students, Rasch analysis",
author = "Norhana Arsad and Noorfazila Kamal and Afida Ayob and Nizaroyani Sarbani and Chong, {Sheau Tsuey} and Norbahiah Misran and Hafizah Husain",
year = "2013",
doi = "10.5539/ies.v6n6p185",
language = "English",
volume = "6",
pages = "185--190",
journal = "International Education Studies",
issn = "1913-9020",
publisher = "Canadian Center of Science and Education",
number = "6",

}

TY - JOUR

T1 - Rasch model analysis on the effectiveness of early evaluation questions as a benchmark for new students ability

AU - Arsad, Norhana

AU - Kamal, Noorfazila

AU - Ayob, Afida

AU - Sarbani, Nizaroyani

AU - Chong, Sheau Tsuey

AU - Misran, Norbahiah

AU - Husain, Hafizah

PY - 2013

Y1 - 2013

N2 - This paper discusses the effectiveness of the early evaluation questions conducted to determine the academic ability of the new students in the Department of Electrical, Electronics and Systems Engineering. Questions designed are knowledge based-on what the students have learned during their pre-university level. The results show students have weak basic knowledge and this is in contrast to the results obtained during the application for admission to Year 1 of university. Thus, early evaluation questions were implemented to see the relevance in assessing the student's ability, obtained by the use of Rasch analysis, WinSteps. The findings show that the initial assessment is an effective and appropriate method to assess the ability of students, where the Cronbach-a is 0.69 and achieve the acceptable ranges of PT-Measure, Mean Square Outfit or Outfit Mean Square (MNSQ) and z-standardized values ??ZSTD) Outfit. This shows that Rasch analysis can be used to classify the questions and the students according to their performance level accurately and thus, reveal the true level of the students" ability, despite the small number of samples.

AB - This paper discusses the effectiveness of the early evaluation questions conducted to determine the academic ability of the new students in the Department of Electrical, Electronics and Systems Engineering. Questions designed are knowledge based-on what the students have learned during their pre-university level. The results show students have weak basic knowledge and this is in contrast to the results obtained during the application for admission to Year 1 of university. Thus, early evaluation questions were implemented to see the relevance in assessing the student's ability, obtained by the use of Rasch analysis, WinSteps. The findings show that the initial assessment is an effective and appropriate method to assess the ability of students, where the Cronbach-a is 0.69 and achieve the acceptable ranges of PT-Measure, Mean Square Outfit or Outfit Mean Square (MNSQ) and z-standardized values ??ZSTD) Outfit. This shows that Rasch analysis can be used to classify the questions and the students according to their performance level accurately and thus, reveal the true level of the students" ability, despite the small number of samples.

KW - Bloom taxonomy

KW - Early evaluation questions

KW - New students

KW - Rasch analysis

UR - http://www.scopus.com/inward/record.url?scp=84878708642&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878708642&partnerID=8YFLogxK

U2 - 10.5539/ies.v6n6p185

DO - 10.5539/ies.v6n6p185

M3 - Article

AN - SCOPUS:84878708642

VL - 6

SP - 185

EP - 190

JO - International Education Studies

JF - International Education Studies

SN - 1913-9020

IS - 6

ER -