A framework for idea mining evaluation

Mostafa Ahmed Alksher, Azreen Azman, Razali Yaakob, Abdul Kadir Rabiah, Abdulmajid Mohamed, Eissa Alshari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Idea mining is a new research topic which is gaining momentous attention among knowledge engineering research community. It aims to extend the benefits of the information retrieval by sifting through historical documents so that valuable machine- proposed ideas can be extracted. This paper is mainly focusing on the evaluation of candidate ideas generated by idea mining systems. The main challenge faced by judges is how to evaluate the extracted ideas. Different evaluation methods are critically explored, and evaluation criteria are proposed accordingly. The results showed that the Likert scale measurement is more reliable than binary scale measurement.

Original languageEnglish
Title of host publicationNew Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017
PublisherIOS Press
Pages550-559
Number of pages10
Volume297
ISBN (Electronic)9781614997993
DOIs
Publication statusPublished - 2017
Event16th International Conference on New Trends in Intelligent Software Methodology Tools, and Techniques, SoMeT 2017 - Kitakyushu, Japan
Duration: 26 Sep 201728 Sep 2017

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume297
ISSN (Print)0922-6389

Other

Other16th International Conference on New Trends in Intelligent Software Methodology Tools, and Techniques, SoMeT 2017
CountryJapan
CityKitakyushu
Period26/9/1728/9/17

Fingerprint

Knowledge engineering
Engineering research
Information retrieval

Keywords

  • Evaluation process
  • Idea mining
  • Idea reliability
  • Text mining

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Alksher, M. A., Azman, A., Yaakob, R., Rabiah, A. K., Mohamed, A., & Alshari, E. (2017). A framework for idea mining evaluation. In New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017 (Vol. 297, pp. 550-559). (Frontiers in Artificial Intelligence and Applications; Vol. 297). IOS Press. https://doi.org/10.3233/978-1-61499-800-6-550

A framework for idea mining evaluation. / Alksher, Mostafa Ahmed; Azman, Azreen; Yaakob, Razali; Rabiah, Abdul Kadir; Mohamed, Abdulmajid; Alshari, Eissa.

New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017. Vol. 297 IOS Press, 2017. p. 550-559 (Frontiers in Artificial Intelligence and Applications; Vol. 297).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Alksher, MA, Azman, A, Yaakob, R, Rabiah, AK, Mohamed, A & Alshari, E 2017, A framework for idea mining evaluation. in New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017. vol. 297, Frontiers in Artificial Intelligence and Applications, vol. 297, IOS Press, pp. 550-559, 16th International Conference on New Trends in Intelligent Software Methodology Tools, and Techniques, SoMeT 2017, Kitakyushu, Japan, 26/9/17. https://doi.org/10.3233/978-1-61499-800-6-550
Alksher MA, Azman A, Yaakob R, Rabiah AK, Mohamed A, Alshari E. A framework for idea mining evaluation. In New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017. Vol. 297. IOS Press. 2017. p. 550-559. (Frontiers in Artificial Intelligence and Applications). https://doi.org/10.3233/978-1-61499-800-6-550
Alksher, Mostafa Ahmed ; Azman, Azreen ; Yaakob, Razali ; Rabiah, Abdul Kadir ; Mohamed, Abdulmajid ; Alshari, Eissa. / A framework for idea mining evaluation. New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017. Vol. 297 IOS Press, 2017. pp. 550-559 (Frontiers in Artificial Intelligence and Applications).
@inproceedings{820510d23868427cb7f919497d3804fd,
title = "A framework for idea mining evaluation",
abstract = "Idea mining is a new research topic which is gaining momentous attention among knowledge engineering research community. It aims to extend the benefits of the information retrieval by sifting through historical documents so that valuable machine- proposed ideas can be extracted. This paper is mainly focusing on the evaluation of candidate ideas generated by idea mining systems. The main challenge faced by judges is how to evaluate the extracted ideas. Different evaluation methods are critically explored, and evaluation criteria are proposed accordingly. The results showed that the Likert scale measurement is more reliable than binary scale measurement.",
keywords = "Evaluation process, Idea mining, Idea reliability, Text mining",
author = "Alksher, {Mostafa Ahmed} and Azreen Azman and Razali Yaakob and Rabiah, {Abdul Kadir} and Abdulmajid Mohamed and Eissa Alshari",
year = "2017",
doi = "10.3233/978-1-61499-800-6-550",
language = "English",
volume = "297",
series = "Frontiers in Artificial Intelligence and Applications",
publisher = "IOS Press",
pages = "550--559",
booktitle = "New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017",

}

TY - GEN

T1 - A framework for idea mining evaluation

AU - Alksher, Mostafa Ahmed

AU - Azman, Azreen

AU - Yaakob, Razali

AU - Rabiah, Abdul Kadir

AU - Mohamed, Abdulmajid

AU - Alshari, Eissa

PY - 2017

Y1 - 2017

N2 - Idea mining is a new research topic which is gaining momentous attention among knowledge engineering research community. It aims to extend the benefits of the information retrieval by sifting through historical documents so that valuable machine- proposed ideas can be extracted. This paper is mainly focusing on the evaluation of candidate ideas generated by idea mining systems. The main challenge faced by judges is how to evaluate the extracted ideas. Different evaluation methods are critically explored, and evaluation criteria are proposed accordingly. The results showed that the Likert scale measurement is more reliable than binary scale measurement.

AB - Idea mining is a new research topic which is gaining momentous attention among knowledge engineering research community. It aims to extend the benefits of the information retrieval by sifting through historical documents so that valuable machine- proposed ideas can be extracted. This paper is mainly focusing on the evaluation of candidate ideas generated by idea mining systems. The main challenge faced by judges is how to evaluate the extracted ideas. Different evaluation methods are critically explored, and evaluation criteria are proposed accordingly. The results showed that the Likert scale measurement is more reliable than binary scale measurement.

KW - Evaluation process

KW - Idea mining

KW - Idea reliability

KW - Text mining

UR - http://www.scopus.com/inward/record.url?scp=85029212226&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029212226&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-800-6-550

DO - 10.3233/978-1-61499-800-6-550

M3 - Conference contribution

VL - 297

T3 - Frontiers in Artificial Intelligence and Applications

SP - 550

EP - 559

BT - New Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017

PB - IOS Press

ER -