Automatic essay grading system for short answers in English language

Ali Muftah Ben Omran, Mohd Juzaiddin Ab Aziz

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Automatic Essay Grading (AEG) system is defined as the computer technology that evaluates and grades written prose. The short essay answer, where the essay is written in short sentences where it has two types the open ended short answer and the close ended short answer where it is our research domain based on the computer subject. The Marking of short essay answers automatically is one of the most complicated domains because it is relying heavily on the semantic similarity in meaning refers to the degree to which two sentences are similar in the meaning where both used similar words in the meaning, in this case Humans are able to easily judge if a concepts are related to each other, there for is a problem when Student use a synonym words during the answer in case they forget the target answer and they use their alternative words in the answer which will be different from the Model answer that prepared by the structure. The Standard text similarity measures perform poorly on such tasks. Short answer only provides a limited content, because the length of the text is typically short, ranging from a single word to a dozen words. This research has two propose;The first propose is Alternative Sentence Generator Method in order to generate the alternative model answer by connecting the method with the synonym dictionary. The second proposed three algorithms combined together in matching phase, Commons Words (COW), Longest Common Subsequence (LCS) and Semantic Distance (SD), these algorithms have been successfully used in many Natural Language Processing systems and have yielded efficient results. The system was manually tested on 40 questions answered by three students and evaluated by teacher in class. The proposed system has yielded %82 correlation-style with human grading, which has made the system significantly better than the other state of the art systems.

Original languageEnglish
Pages (from-to)1369-1382
Number of pages14
JournalJournal of Computer Science
Volume9
Issue number10
DOIs
Publication statusPublished - 2013

Fingerprint

Natural language processing systems
Semantics
Students
Phase matching
Glossaries

Keywords

  • Cow
  • Lcs
  • Sd
  • Semantic similarity
  • Short answer
  • Synonym

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications
  • Artificial Intelligence

Cite this

Automatic essay grading system for short answers in English language. / Omran, Ali Muftah Ben; Ab Aziz, Mohd Juzaiddin.

In: Journal of Computer Science, Vol. 9, No. 10, 2013, p. 1369-1382.

Research output: Contribution to journalArticle

@article{f79d56da762849a2b2f74602900a9f91,
title = "Automatic essay grading system for short answers in English language",
abstract = "Automatic Essay Grading (AEG) system is defined as the computer technology that evaluates and grades written prose. The short essay answer, where the essay is written in short sentences where it has two types the open ended short answer and the close ended short answer where it is our research domain based on the computer subject. The Marking of short essay answers automatically is one of the most complicated domains because it is relying heavily on the semantic similarity in meaning refers to the degree to which two sentences are similar in the meaning where both used similar words in the meaning, in this case Humans are able to easily judge if a concepts are related to each other, there for is a problem when Student use a synonym words during the answer in case they forget the target answer and they use their alternative words in the answer which will be different from the Model answer that prepared by the structure. The Standard text similarity measures perform poorly on such tasks. Short answer only provides a limited content, because the length of the text is typically short, ranging from a single word to a dozen words. This research has two propose;The first propose is Alternative Sentence Generator Method in order to generate the alternative model answer by connecting the method with the synonym dictionary. The second proposed three algorithms combined together in matching phase, Commons Words (COW), Longest Common Subsequence (LCS) and Semantic Distance (SD), these algorithms have been successfully used in many Natural Language Processing systems and have yielded efficient results. The system was manually tested on 40 questions answered by three students and evaluated by teacher in class. The proposed system has yielded {\%}82 correlation-style with human grading, which has made the system significantly better than the other state of the art systems.",
keywords = "Cow, Lcs, Sd, Semantic similarity, Short answer, Synonym",
author = "Omran, {Ali Muftah Ben} and {Ab Aziz}, {Mohd Juzaiddin}",
year = "2013",
doi = "10.3844/jcssp.2013.1369.1382",
language = "English",
volume = "9",
pages = "1369--1382",
journal = "Journal of Computer Science",
issn = "1549-3636",
publisher = "Science Publications",
number = "10",

}

TY - JOUR

T1 - Automatic essay grading system for short answers in English language

AU - Omran, Ali Muftah Ben

AU - Ab Aziz, Mohd Juzaiddin

PY - 2013

Y1 - 2013

N2 - Automatic Essay Grading (AEG) system is defined as the computer technology that evaluates and grades written prose. The short essay answer, where the essay is written in short sentences where it has two types the open ended short answer and the close ended short answer where it is our research domain based on the computer subject. The Marking of short essay answers automatically is one of the most complicated domains because it is relying heavily on the semantic similarity in meaning refers to the degree to which two sentences are similar in the meaning where both used similar words in the meaning, in this case Humans are able to easily judge if a concepts are related to each other, there for is a problem when Student use a synonym words during the answer in case they forget the target answer and they use their alternative words in the answer which will be different from the Model answer that prepared by the structure. The Standard text similarity measures perform poorly on such tasks. Short answer only provides a limited content, because the length of the text is typically short, ranging from a single word to a dozen words. This research has two propose;The first propose is Alternative Sentence Generator Method in order to generate the alternative model answer by connecting the method with the synonym dictionary. The second proposed three algorithms combined together in matching phase, Commons Words (COW), Longest Common Subsequence (LCS) and Semantic Distance (SD), these algorithms have been successfully used in many Natural Language Processing systems and have yielded efficient results. The system was manually tested on 40 questions answered by three students and evaluated by teacher in class. The proposed system has yielded %82 correlation-style with human grading, which has made the system significantly better than the other state of the art systems.

AB - Automatic Essay Grading (AEG) system is defined as the computer technology that evaluates and grades written prose. The short essay answer, where the essay is written in short sentences where it has two types the open ended short answer and the close ended short answer where it is our research domain based on the computer subject. The Marking of short essay answers automatically is one of the most complicated domains because it is relying heavily on the semantic similarity in meaning refers to the degree to which two sentences are similar in the meaning where both used similar words in the meaning, in this case Humans are able to easily judge if a concepts are related to each other, there for is a problem when Student use a synonym words during the answer in case they forget the target answer and they use their alternative words in the answer which will be different from the Model answer that prepared by the structure. The Standard text similarity measures perform poorly on such tasks. Short answer only provides a limited content, because the length of the text is typically short, ranging from a single word to a dozen words. This research has two propose;The first propose is Alternative Sentence Generator Method in order to generate the alternative model answer by connecting the method with the synonym dictionary. The second proposed three algorithms combined together in matching phase, Commons Words (COW), Longest Common Subsequence (LCS) and Semantic Distance (SD), these algorithms have been successfully used in many Natural Language Processing systems and have yielded efficient results. The system was manually tested on 40 questions answered by three students and evaluated by teacher in class. The proposed system has yielded %82 correlation-style with human grading, which has made the system significantly better than the other state of the art systems.

KW - Cow

KW - Lcs

KW - Sd

KW - Semantic similarity

KW - Short answer

KW - Synonym

UR - http://www.scopus.com/inward/record.url?scp=84890348627&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84890348627&partnerID=8YFLogxK

U2 - 10.3844/jcssp.2013.1369.1382

DO - 10.3844/jcssp.2013.1369.1382

M3 - Article

AN - SCOPUS:84890348627

VL - 9

SP - 1369

EP - 1382

JO - Journal of Computer Science

JF - Journal of Computer Science

SN - 1549-3636

IS - 10

ER -