Bloom's taxonomy question categorization using rules and N-gram approach

Syahidah Sufi Haris, Nazlia Omar

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. An experiment was designed to investigate student’s cognitive level, by developing rules to determine the categorization of questions based on Bloom's Taxonomy (BT). A sample of 135 questions collected from final examination past questions from FTSM, UKM. All questions has been analyzed by Computer Science subject matter experts to identify cognitive category based on BT. Rules are developed by analyzing the syntactic structure from the text questions. Next, some adjustment are made to utilize hybrid ability of rules and statistical approach. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. The advantage of this approach is that statistical classifier will assist the categorization when questions are not categorized by the rules. This approach gives better flexiblity when a set of 64 rules are developed for programming question domain. The result yeilds 86% for the average F1 for the hybrid technique. The outcome of this study suggest that the combined technique is capable of identifying the correct cognitive category of BT.

Original languageEnglish
Pages (from-to)401-407
Number of pages7
JournalJournal of Theoretical and Applied Information Technology
Volume76
Issue number3
Publication statusPublished - 30 Jun 2015

Fingerprint

N-gram
Taxonomies
Categorization
Taxonomy
Students
Syntactics
Computer science
Classifiers
Natural Language
Education
Adjustment
Computer Science
Programming
Classifier
Verify
Processing
Experiments
Experiment

Keywords

  • Bloom’s Taxonomy
  • Categorizing question
  • Hybrid technique
  • Programming questions

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Bloom's taxonomy question categorization using rules and N-gram approach. / Haris, Syahidah Sufi; Omar, Nazlia.

In: Journal of Theoretical and Applied Information Technology, Vol. 76, No. 3, 30.06.2015, p. 401-407.

Research output: Contribution to journalArticle

@article{8871a71db1c049fdb3530fed807cb047,
title = "Bloom's taxonomy question categorization using rules and N-gram approach",
abstract = "Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. An experiment was designed to investigate student’s cognitive level, by developing rules to determine the categorization of questions based on Bloom's Taxonomy (BT). A sample of 135 questions collected from final examination past questions from FTSM, UKM. All questions has been analyzed by Computer Science subject matter experts to identify cognitive category based on BT. Rules are developed by analyzing the syntactic structure from the text questions. Next, some adjustment are made to utilize hybrid ability of rules and statistical approach. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. The advantage of this approach is that statistical classifier will assist the categorization when questions are not categorized by the rules. This approach gives better flexiblity when a set of 64 rules are developed for programming question domain. The result yeilds 86{\%} for the average F1 for the hybrid technique. The outcome of this study suggest that the combined technique is capable of identifying the correct cognitive category of BT.",
keywords = "Bloom’s Taxonomy, Categorizing question, Hybrid technique, Programming questions",
author = "Haris, {Syahidah Sufi} and Nazlia Omar",
year = "2015",
month = "6",
day = "30",
language = "English",
volume = "76",
pages = "401--407",
journal = "Journal of Theoretical and Applied Information Technology",
issn = "1992-8645",
publisher = "Asian Research Publishing Network (ARPN)",
number = "3",

}

TY - JOUR

T1 - Bloom's taxonomy question categorization using rules and N-gram approach

AU - Haris, Syahidah Sufi

AU - Omar, Nazlia

PY - 2015/6/30

Y1 - 2015/6/30

N2 - Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. An experiment was designed to investigate student’s cognitive level, by developing rules to determine the categorization of questions based on Bloom's Taxonomy (BT). A sample of 135 questions collected from final examination past questions from FTSM, UKM. All questions has been analyzed by Computer Science subject matter experts to identify cognitive category based on BT. Rules are developed by analyzing the syntactic structure from the text questions. Next, some adjustment are made to utilize hybrid ability of rules and statistical approach. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. The advantage of this approach is that statistical classifier will assist the categorization when questions are not categorized by the rules. This approach gives better flexiblity when a set of 64 rules are developed for programming question domain. The result yeilds 86% for the average F1 for the hybrid technique. The outcome of this study suggest that the combined technique is capable of identifying the correct cognitive category of BT.

AB - Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. An experiment was designed to investigate student’s cognitive level, by developing rules to determine the categorization of questions based on Bloom's Taxonomy (BT). A sample of 135 questions collected from final examination past questions from FTSM, UKM. All questions has been analyzed by Computer Science subject matter experts to identify cognitive category based on BT. Rules are developed by analyzing the syntactic structure from the text questions. Next, some adjustment are made to utilize hybrid ability of rules and statistical approach. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. The advantage of this approach is that statistical classifier will assist the categorization when questions are not categorized by the rules. This approach gives better flexiblity when a set of 64 rules are developed for programming question domain. The result yeilds 86% for the average F1 for the hybrid technique. The outcome of this study suggest that the combined technique is capable of identifying the correct cognitive category of BT.

KW - Bloom’s Taxonomy

KW - Categorizing question

KW - Hybrid technique

KW - Programming questions

UR - http://www.scopus.com/inward/record.url?scp=84934761897&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84934761897&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84934761897

VL - 76

SP - 401

EP - 407

JO - Journal of Theoretical and Applied Information Technology

JF - Journal of Theoretical and Applied Information Technology

SN - 1992-8645

IS - 3

ER -