Use of content analysis tools for visual interaction design

Nazlena Mohamad Ali, Hyowon Lee, Alan F. Smeaton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages74-84
Number of pages11
Volume7067 LNCS
EditionPART 2
DOIs
Publication statusPublished - 2011
Event2nd International Visual Informatics Conference, IVIC 2011 - Selangor
Duration: 9 Nov 201111 Nov 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume7067 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other2nd International Visual Informatics Conference, IVIC 2011
CitySelangor
Period9/11/1111/11/11

Fingerprint

Interaction Design
Content Analysis
Computer vision
User interfaces
Multimedia
Summarization
Browsing
Computer Vision
User Interface
Transform
Scenarios
Vision

Keywords

  • content analysis
  • video browsing
  • Visual Informatics
  • visual interaction design
  • visualization

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Mohamad Ali, N., Lee, H., & Smeaton, A. F. (2011). Use of content analysis tools for visual interaction design. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 2 ed., Vol. 7067 LNCS, pp. 74-84). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7067 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-25200-6_8

Use of content analysis tools for visual interaction design. / Mohamad Ali, Nazlena; Lee, Hyowon; Smeaton, Alan F.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7067 LNCS PART 2. ed. 2011. p. 74-84 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7067 LNCS, No. PART 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mohamad Ali, N, Lee, H & Smeaton, AF 2011, Use of content analysis tools for visual interaction design. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 edn, vol. 7067 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 7067 LNCS, pp. 74-84, 2nd International Visual Informatics Conference, IVIC 2011, Selangor, 9/11/11. https://doi.org/10.1007/978-3-642-25200-6_8
Mohamad Ali N, Lee H, Smeaton AF. Use of content analysis tools for visual interaction design. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 ed. Vol. 7067 LNCS. 2011. p. 74-84. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-642-25200-6_8
Mohamad Ali, Nazlena ; Lee, Hyowon ; Smeaton, Alan F. / Use of content analysis tools for visual interaction design. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7067 LNCS PART 2. ed. 2011. pp. 74-84 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).
@inproceedings{7f9edac373094e55bf2360eaa895b4a7,
title = "Use of content analysis tools for visual interaction design",
abstract = "Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.",
keywords = "content analysis, video browsing, Visual Informatics, visual interaction design, visualization",
author = "{Mohamad Ali}, Nazlena and Hyowon Lee and Smeaton, {Alan F.}",
year = "2011",
doi = "10.1007/978-3-642-25200-6_8",
language = "English",
isbn = "9783642251993",
volume = "7067 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 2",
pages = "74--84",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 2",

}

TY - GEN

T1 - Use of content analysis tools for visual interaction design

AU - Mohamad Ali, Nazlena

AU - Lee, Hyowon

AU - Smeaton, Alan F.

PY - 2011

Y1 - 2011

N2 - Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.

AB - Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.

KW - content analysis

KW - video browsing

KW - Visual Informatics

KW - visual interaction design

KW - visualization

UR - http://www.scopus.com/inward/record.url?scp=81255165724&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81255165724&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-25200-6_8

DO - 10.1007/978-3-642-25200-6_8

M3 - Conference contribution

SN - 9783642251993

VL - 7067 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 74

EP - 84

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -