The development and validation of conceptual and procedural understanding test for integral calculus

Tuan Salwani Awang Salleh, Effandi Zakaria

Research output: Contribution to journalArticle

Abstract

This study discusses the process of developing and validating a conceptual and procedural understanding test for integral calculus. The aim was to produce a valid and reliable test to measure students' understanding of both types of knowledge, conceptual and procedural, in integral calculus. The test questions were developed in four main stages consisting of eight distinct systematic phases. The validation process started with discussions with content experts followed by a pilot test. Four experts provided inputs for the content validity purposes. Their inputs were used to produce a valid set of Integral Calculus achievement test comprising 15 questions. A pilot test assessed the reliability and fit statistics of the test. The test was administered to 79 students in a higher learning institution selected randomly from a group of students taking Integral Calculus. The data was analyzed using Winstep's software to ensure the quality of the questions. The analysis was done separately for each construct. The results indicated excellent item reliability indices with very good index separation values for both constructs. However, the person reliability indices for both constructs were only fair to good. Likewise, the results revealed only fair index separation values. In terms of fit statistics, three conceptual understanding items were replaced with a new item. Meanwhile, for procedural understanding items, two items were combined and one misfitting item was modified. Based on the experts' views and empirical data, the test questions were modified before they were used in the actual study.

Original languageEnglish
Pages (from-to)1805-1814
Number of pages10
JournalResearch Journal of Applied Sciences, Engineering and Technology
Volume4
Issue number12
Publication statusPublished - 2012

Fingerprint

Students
Statistics

Keywords

  • Achievement
  • Conceptual understanding
  • Integral calculus
  • Procedural understanding
  • Rasch measurement model

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science(all)

Cite this

The development and validation of conceptual and procedural understanding test for integral calculus. / Salleh, Tuan Salwani Awang; Zakaria, Effandi.

In: Research Journal of Applied Sciences, Engineering and Technology, Vol. 4, No. 12, 2012, p. 1805-1814.

Research output: Contribution to journalArticle

@article{400780d21819406e9c82570c14f8ae8f,
title = "The development and validation of conceptual and procedural understanding test for integral calculus",
abstract = "This study discusses the process of developing and validating a conceptual and procedural understanding test for integral calculus. The aim was to produce a valid and reliable test to measure students' understanding of both types of knowledge, conceptual and procedural, in integral calculus. The test questions were developed in four main stages consisting of eight distinct systematic phases. The validation process started with discussions with content experts followed by a pilot test. Four experts provided inputs for the content validity purposes. Their inputs were used to produce a valid set of Integral Calculus achievement test comprising 15 questions. A pilot test assessed the reliability and fit statistics of the test. The test was administered to 79 students in a higher learning institution selected randomly from a group of students taking Integral Calculus. The data was analyzed using Winstep's software to ensure the quality of the questions. The analysis was done separately for each construct. The results indicated excellent item reliability indices with very good index separation values for both constructs. However, the person reliability indices for both constructs were only fair to good. Likewise, the results revealed only fair index separation values. In terms of fit statistics, three conceptual understanding items were replaced with a new item. Meanwhile, for procedural understanding items, two items were combined and one misfitting item was modified. Based on the experts' views and empirical data, the test questions were modified before they were used in the actual study.",
keywords = "Achievement, Conceptual understanding, Integral calculus, Procedural understanding, Rasch measurement model",
author = "Salleh, {Tuan Salwani Awang} and Effandi Zakaria",
year = "2012",
language = "English",
volume = "4",
pages = "1805--1814",
journal = "Research Journal of Applied Sciences, Engineering and Technology",
issn = "2040-7459",
publisher = "Maxwell Scientific Publications",
number = "12",

}

TY - JOUR

T1 - The development and validation of conceptual and procedural understanding test for integral calculus

AU - Salleh, Tuan Salwani Awang

AU - Zakaria, Effandi

PY - 2012

Y1 - 2012

N2 - This study discusses the process of developing and validating a conceptual and procedural understanding test for integral calculus. The aim was to produce a valid and reliable test to measure students' understanding of both types of knowledge, conceptual and procedural, in integral calculus. The test questions were developed in four main stages consisting of eight distinct systematic phases. The validation process started with discussions with content experts followed by a pilot test. Four experts provided inputs for the content validity purposes. Their inputs were used to produce a valid set of Integral Calculus achievement test comprising 15 questions. A pilot test assessed the reliability and fit statistics of the test. The test was administered to 79 students in a higher learning institution selected randomly from a group of students taking Integral Calculus. The data was analyzed using Winstep's software to ensure the quality of the questions. The analysis was done separately for each construct. The results indicated excellent item reliability indices with very good index separation values for both constructs. However, the person reliability indices for both constructs were only fair to good. Likewise, the results revealed only fair index separation values. In terms of fit statistics, three conceptual understanding items were replaced with a new item. Meanwhile, for procedural understanding items, two items were combined and one misfitting item was modified. Based on the experts' views and empirical data, the test questions were modified before they were used in the actual study.

AB - This study discusses the process of developing and validating a conceptual and procedural understanding test for integral calculus. The aim was to produce a valid and reliable test to measure students' understanding of both types of knowledge, conceptual and procedural, in integral calculus. The test questions were developed in four main stages consisting of eight distinct systematic phases. The validation process started with discussions with content experts followed by a pilot test. Four experts provided inputs for the content validity purposes. Their inputs were used to produce a valid set of Integral Calculus achievement test comprising 15 questions. A pilot test assessed the reliability and fit statistics of the test. The test was administered to 79 students in a higher learning institution selected randomly from a group of students taking Integral Calculus. The data was analyzed using Winstep's software to ensure the quality of the questions. The analysis was done separately for each construct. The results indicated excellent item reliability indices with very good index separation values for both constructs. However, the person reliability indices for both constructs were only fair to good. Likewise, the results revealed only fair index separation values. In terms of fit statistics, three conceptual understanding items were replaced with a new item. Meanwhile, for procedural understanding items, two items were combined and one misfitting item was modified. Based on the experts' views and empirical data, the test questions were modified before they were used in the actual study.

KW - Achievement

KW - Conceptual understanding

KW - Integral calculus

KW - Procedural understanding

KW - Rasch measurement model

UR - http://www.scopus.com/inward/record.url?scp=84862062247&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862062247&partnerID=8YFLogxK

M3 - Article

VL - 4

SP - 1805

EP - 1814

JO - Research Journal of Applied Sciences, Engineering and Technology

JF - Research Journal of Applied Sciences, Engineering and Technology

SN - 2040-7459

IS - 12

ER -