A real-time vision-based framework for human-robot interaction

Lam Meng Chun, Anton Satria Prabuwono, Haslina Arshad, Chee Seng Chan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Building human-friendly robots which are able to interact and cooperate with humans has been an active research field in recent years. A major challenge in this field is to develop robots that can interact and cooperate with humans by understanding human communication modalities. Nonetheless, human face is a dynamic object and has a high degree of variability in its appearance, which makes face detection a difficult problem. In this paper, we present a real-time vision-based framework to detect human face and analysis of the human face direction in window area to interact with robot. A cascade of feature detectors trained with boosting technique has been employed. Experimental results using servo motors connect to SD21 and PIC16F887A microcontroller; and the MIABOT Pro have validated our approach. Our future work is to build an intelligent wheelchair whose motion can be controlled by the user's face direction.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages257-267
Number of pages11
Volume7066 LNCS
EditionPART 1
DOIs
Publication statusPublished - 2011
Event2nd International Visual Informatics Conference, IVIC 2011 - Selangor
Duration: 9 Nov 201111 Nov 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume7066 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other2nd International Visual Informatics Conference, IVIC 2011
CitySelangor
Period9/11/1111/11/11

Fingerprint

Human-robot Interaction
Human robot interaction
Robots
Real-time
Face
Wheelchairs
Microcontrollers
Face recognition
Robot
Detectors
Communication
Face Detection
Microcontroller
Boosting
Human
Vision
Framework
Modality
Cascade
Detector

Keywords

  • AdaBoost algorithm
  • face detection
  • human-robot interaction
  • Vision-based framework
  • Visual Informatics

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Meng Chun, L., Prabuwono, A. S., Arshad, H., & Chan, C. S. (2011). A real-time vision-based framework for human-robot interaction. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 1 ed., Vol. 7066 LNCS, pp. 257-267). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7066 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-25191-7_25

A real-time vision-based framework for human-robot interaction. / Meng Chun, Lam; Prabuwono, Anton Satria; Arshad, Haslina; Chan, Chee Seng.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7066 LNCS PART 1. ed. 2011. p. 257-267 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7066 LNCS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Meng Chun, L, Prabuwono, AS, Arshad, H & Chan, CS 2011, A real-time vision-based framework for human-robot interaction. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 edn, vol. 7066 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 7066 LNCS, pp. 257-267, 2nd International Visual Informatics Conference, IVIC 2011, Selangor, 9/11/11. https://doi.org/10.1007/978-3-642-25191-7_25
Meng Chun L, Prabuwono AS, Arshad H, Chan CS. A real-time vision-based framework for human-robot interaction. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 ed. Vol. 7066 LNCS. 2011. p. 257-267. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). https://doi.org/10.1007/978-3-642-25191-7_25
Meng Chun, Lam ; Prabuwono, Anton Satria ; Arshad, Haslina ; Chan, Chee Seng. / A real-time vision-based framework for human-robot interaction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7066 LNCS PART 1. ed. 2011. pp. 257-267 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).
@inproceedings{7895690e1c104123ba0886b41ab58b73,
title = "A real-time vision-based framework for human-robot interaction",
abstract = "Building human-friendly robots which are able to interact and cooperate with humans has been an active research field in recent years. A major challenge in this field is to develop robots that can interact and cooperate with humans by understanding human communication modalities. Nonetheless, human face is a dynamic object and has a high degree of variability in its appearance, which makes face detection a difficult problem. In this paper, we present a real-time vision-based framework to detect human face and analysis of the human face direction in window area to interact with robot. A cascade of feature detectors trained with boosting technique has been employed. Experimental results using servo motors connect to SD21 and PIC16F887A microcontroller; and the MIABOT Pro have validated our approach. Our future work is to build an intelligent wheelchair whose motion can be controlled by the user's face direction.",
keywords = "AdaBoost algorithm, face detection, human-robot interaction, Vision-based framework, Visual Informatics",
author = "{Meng Chun}, Lam and Prabuwono, {Anton Satria} and Haslina Arshad and Chan, {Chee Seng}",
year = "2011",
doi = "10.1007/978-3-642-25191-7_25",
language = "English",
isbn = "9783642251900",
volume = "7066 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 1",
pages = "257--267",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 1",

}

TY - GEN

T1 - A real-time vision-based framework for human-robot interaction

AU - Meng Chun, Lam

AU - Prabuwono, Anton Satria

AU - Arshad, Haslina

AU - Chan, Chee Seng

PY - 2011

Y1 - 2011

N2 - Building human-friendly robots which are able to interact and cooperate with humans has been an active research field in recent years. A major challenge in this field is to develop robots that can interact and cooperate with humans by understanding human communication modalities. Nonetheless, human face is a dynamic object and has a high degree of variability in its appearance, which makes face detection a difficult problem. In this paper, we present a real-time vision-based framework to detect human face and analysis of the human face direction in window area to interact with robot. A cascade of feature detectors trained with boosting technique has been employed. Experimental results using servo motors connect to SD21 and PIC16F887A microcontroller; and the MIABOT Pro have validated our approach. Our future work is to build an intelligent wheelchair whose motion can be controlled by the user's face direction.

AB - Building human-friendly robots which are able to interact and cooperate with humans has been an active research field in recent years. A major challenge in this field is to develop robots that can interact and cooperate with humans by understanding human communication modalities. Nonetheless, human face is a dynamic object and has a high degree of variability in its appearance, which makes face detection a difficult problem. In this paper, we present a real-time vision-based framework to detect human face and analysis of the human face direction in window area to interact with robot. A cascade of feature detectors trained with boosting technique has been employed. Experimental results using servo motors connect to SD21 and PIC16F887A microcontroller; and the MIABOT Pro have validated our approach. Our future work is to build an intelligent wheelchair whose motion can be controlled by the user's face direction.

KW - AdaBoost algorithm

KW - face detection

KW - human-robot interaction

KW - Vision-based framework

KW - Visual Informatics

UR - http://www.scopus.com/inward/record.url?scp=81255193898&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81255193898&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-25191-7_25

DO - 10.1007/978-3-642-25191-7_25

M3 - Conference contribution

SN - 9783642251900

VL - 7066 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 257

EP - 267

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -