Modelling image semantic descriptions from web 2.0 documents using a hybrid approach

Lailatul Qadri Zakaria, Wendy Hall, Paul Lewis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

With the increasing amount of multimedia content on the web added as user generated content in Web 2.0 websites, conventional multimedia information retrieval is presented with new challenges. It is no longer possible to rely only on meta-data based retrieval but to consider also content based techniques combined with the collective knowledge generated by users' contributions and geo-referenced meta-data. Tagging is a modest way to annotate such documents and fails to capture a full semantic description of the document content. This report concerns ongoing research to investigate a means to identify, model and utilise semantic descriptions of the user-generated content in Web 2.0 documents using a hybrid approach. The approach consists of three main components, natural language processing, image analysis and a shared knowledge base. In this paper we describe the complete model but, as the image analysis component is in its early stages, the results focus on the natural language processing and the knowledge base. We show that the additional use of these components can improve retrieval and analysis performance over that based only on Web 2.0 tags.

Original languageEnglish
Title of host publicationiiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services
Pages306-312
Number of pages7
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event11th International Conference on Information Integration and Web-based Applications and Services, iiWAS2009 - Kuala Lumpur
Duration: 14 Dec 200916 Dec 2009

Other

Other11th International Conference on Information Integration and Web-based Applications and Services, iiWAS2009
CityKuala Lumpur
Period14/12/0916/12/09

Fingerprint

Metadata
Image analysis
Semantics
Processing
Information retrieval
World Wide Web
Websites

Keywords

  • image semantic description
  • knowledge base
  • natural language analysis
  • ontology
  • semantic web

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Cite this

Zakaria, L. Q., Hall, W., & Lewis, P. (2009). Modelling image semantic descriptions from web 2.0 documents using a hybrid approach. In iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services (pp. 306-312) https://doi.org/10.1145/1806338.1806395

Modelling image semantic descriptions from web 2.0 documents using a hybrid approach. / Zakaria, Lailatul Qadri; Hall, Wendy; Lewis, Paul.

iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services. 2009. p. 306-312.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zakaria, LQ, Hall, W & Lewis, P 2009, Modelling image semantic descriptions from web 2.0 documents using a hybrid approach. in iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services. pp. 306-312, 11th International Conference on Information Integration and Web-based Applications and Services, iiWAS2009, Kuala Lumpur, 14/12/09. https://doi.org/10.1145/1806338.1806395
Zakaria LQ, Hall W, Lewis P. Modelling image semantic descriptions from web 2.0 documents using a hybrid approach. In iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services. 2009. p. 306-312 https://doi.org/10.1145/1806338.1806395
Zakaria, Lailatul Qadri ; Hall, Wendy ; Lewis, Paul. / Modelling image semantic descriptions from web 2.0 documents using a hybrid approach. iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services. 2009. pp. 306-312
@inproceedings{4bfa8b499900407b8c9c322408c3938a,
title = "Modelling image semantic descriptions from web 2.0 documents using a hybrid approach",
abstract = "With the increasing amount of multimedia content on the web added as user generated content in Web 2.0 websites, conventional multimedia information retrieval is presented with new challenges. It is no longer possible to rely only on meta-data based retrieval but to consider also content based techniques combined with the collective knowledge generated by users' contributions and geo-referenced meta-data. Tagging is a modest way to annotate such documents and fails to capture a full semantic description of the document content. This report concerns ongoing research to investigate a means to identify, model and utilise semantic descriptions of the user-generated content in Web 2.0 documents using a hybrid approach. The approach consists of three main components, natural language processing, image analysis and a shared knowledge base. In this paper we describe the complete model but, as the image analysis component is in its early stages, the results focus on the natural language processing and the knowledge base. We show that the additional use of these components can improve retrieval and analysis performance over that based only on Web 2.0 tags.",
keywords = "image semantic description, knowledge base, natural language analysis, ontology, semantic web",
author = "Zakaria, {Lailatul Qadri} and Wendy Hall and Paul Lewis",
year = "2009",
doi = "10.1145/1806338.1806395",
language = "English",
isbn = "9781605586601",
pages = "306--312",
booktitle = "iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services",

}

TY - GEN

T1 - Modelling image semantic descriptions from web 2.0 documents using a hybrid approach

AU - Zakaria, Lailatul Qadri

AU - Hall, Wendy

AU - Lewis, Paul

PY - 2009

Y1 - 2009

N2 - With the increasing amount of multimedia content on the web added as user generated content in Web 2.0 websites, conventional multimedia information retrieval is presented with new challenges. It is no longer possible to rely only on meta-data based retrieval but to consider also content based techniques combined with the collective knowledge generated by users' contributions and geo-referenced meta-data. Tagging is a modest way to annotate such documents and fails to capture a full semantic description of the document content. This report concerns ongoing research to investigate a means to identify, model and utilise semantic descriptions of the user-generated content in Web 2.0 documents using a hybrid approach. The approach consists of three main components, natural language processing, image analysis and a shared knowledge base. In this paper we describe the complete model but, as the image analysis component is in its early stages, the results focus on the natural language processing and the knowledge base. We show that the additional use of these components can improve retrieval and analysis performance over that based only on Web 2.0 tags.

AB - With the increasing amount of multimedia content on the web added as user generated content in Web 2.0 websites, conventional multimedia information retrieval is presented with new challenges. It is no longer possible to rely only on meta-data based retrieval but to consider also content based techniques combined with the collective knowledge generated by users' contributions and geo-referenced meta-data. Tagging is a modest way to annotate such documents and fails to capture a full semantic description of the document content. This report concerns ongoing research to investigate a means to identify, model and utilise semantic descriptions of the user-generated content in Web 2.0 documents using a hybrid approach. The approach consists of three main components, natural language processing, image analysis and a shared knowledge base. In this paper we describe the complete model but, as the image analysis component is in its early stages, the results focus on the natural language processing and the knowledge base. We show that the additional use of these components can improve retrieval and analysis performance over that based only on Web 2.0 tags.

KW - image semantic description

KW - knowledge base

KW - natural language analysis

KW - ontology

KW - semantic web

UR - http://www.scopus.com/inward/record.url?scp=77954598182&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954598182&partnerID=8YFLogxK

U2 - 10.1145/1806338.1806395

DO - 10.1145/1806338.1806395

M3 - Conference contribution

AN - SCOPUS:77954598182

SN - 9781605586601

SP - 306

EP - 312

BT - iiWAS2009 - The 11th International Conference on Information Integration and Web-based Applications and Services

ER -