Statistical Malay dependency parser for knowledge acquisition based on word dependency relation

Hassan Mohamed, Nazlia Omar, Mohd Juzaiddin Ab Aziz, Suhaimi Ab Rahman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

Original languageEnglish
Title of host publicationProcedia - Social and Behavioral Sciences
Pages188-193
Number of pages6
Volume27
DOIs
Publication statusPublished - 2011
EventConference on Pacific Association for Computational Linguistics, PACLING 2011 - Kuala Lumpur, Malaysia
Duration: 19 Jul 201121 Jul 2011

Other

OtherConference on Pacific Association for Computational Linguistics, PACLING 2011
CountryMalaysia
CityKuala Lumpur
Period19/7/1121/7/11

Fingerprint

knowledge acquisition
grammar
Language
Natural Language Processing
Automatic Data Processing
Semantics
language
information processing
semantics
Values

Keywords

  • Dependency Grammar
  • Dependency Parser
  • Malay corpus
  • Malay Parser
  • Parser
  • Syntactic Relation

ASJC Scopus subject areas

  • Social Sciences(all)
  • Psychology(all)

Cite this

Statistical Malay dependency parser for knowledge acquisition based on word dependency relation. / Mohamed, Hassan; Omar, Nazlia; Ab Aziz, Mohd Juzaiddin; Rahman, Suhaimi Ab.

Procedia - Social and Behavioral Sciences. Vol. 27 2011. p. 188-193.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mohamed, H, Omar, N, Ab Aziz, MJ & Rahman, SA 2011, Statistical Malay dependency parser for knowledge acquisition based on word dependency relation. in Procedia - Social and Behavioral Sciences. vol. 27, pp. 188-193, Conference on Pacific Association for Computational Linguistics, PACLING 2011, Kuala Lumpur, Malaysia, 19/7/11. https://doi.org/10.1016/j.sbspro.2011.10.597
Mohamed, Hassan ; Omar, Nazlia ; Ab Aziz, Mohd Juzaiddin ; Rahman, Suhaimi Ab. / Statistical Malay dependency parser for knowledge acquisition based on word dependency relation. Procedia - Social and Behavioral Sciences. Vol. 27 2011. pp. 188-193
@inproceedings{64ec176f46134ff4a17a65ffb781c07d,
title = "Statistical Malay dependency parser for knowledge acquisition based on word dependency relation",
abstract = "One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.",
keywords = "Dependency Grammar, Dependency Parser, Malay corpus, Malay Parser, Parser, Syntactic Relation",
author = "Hassan Mohamed and Nazlia Omar and {Ab Aziz}, {Mohd Juzaiddin} and Rahman, {Suhaimi Ab}",
year = "2011",
doi = "10.1016/j.sbspro.2011.10.597",
language = "English",
volume = "27",
pages = "188--193",
booktitle = "Procedia - Social and Behavioral Sciences",

}

TY - GEN

T1 - Statistical Malay dependency parser for knowledge acquisition based on word dependency relation

AU - Mohamed, Hassan

AU - Omar, Nazlia

AU - Ab Aziz, Mohd Juzaiddin

AU - Rahman, Suhaimi Ab

PY - 2011

Y1 - 2011

N2 - One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

AB - One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

KW - Dependency Grammar

KW - Dependency Parser

KW - Malay corpus

KW - Malay Parser

KW - Parser

KW - Syntactic Relation

UR - http://www.scopus.com/inward/record.url?scp=83755171540&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=83755171540&partnerID=8YFLogxK

U2 - 10.1016/j.sbspro.2011.10.597

DO - 10.1016/j.sbspro.2011.10.597

M3 - Conference contribution

VL - 27

SP - 188

EP - 193

BT - Procedia - Social and Behavioral Sciences

ER -