Interaction techniques in desktop virtual environment

the study of visual feedback and precise manipulation method

Lam Meng Chun, Haslina Arshad, Anton Satria Prabuwono, Siok Yee Tan, S. M.M. Kahaki

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the object less precise. This paper investigated two new interaction techniques in a virtual environment. It describes the influence of natural and non-natural virtual feedback in the selection process using the GITDVR-G interaction technique, which consists of a grasping visual feedback. The GITDVR-G was evaluated in a virtual knee surgery training system. The results showed that it was effective in terms of the task completion time, and that the participants preferred the natural grasping visual feedback. Besides that, the precise manipulation in a newly-designed interaction technique (Precise GITDVR-G) was evaluated. The Precise GITDVR-G includes a normal manipulation mode and a precise manipulation mode that can be triggered by hand gestures. During the precise manipulation mode, an inset view will appear and move with the selected object to provide a better view to users, while the movements of the virtual hand are scaled down to improve the precision. Four different configurations of the precise manipulation technique were evaluated, and the results showed that the unimanual control method with an inset view performed better in terms of the task performance time and the subjective feedback. The finding suggested that the realistic virtual grasping visual feedback can be applied in a virtual hand interaction technique, and that the inset view feature is helpful in the precise manipulation.

Original languageEnglish
Pages (from-to)1-32
Number of pages32
JournalMultimedia Tools and Applications
DOIs
Publication statusAccepted/In press - 22 Sep 2017

Fingerprint

Virtual reality
Feedback
Surgery

Keywords

  • Hand gesture
  • Interaction technique
  • Virtual grasping
  • Virtual training system

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Interaction techniques in desktop virtual environment : the study of visual feedback and precise manipulation method. / Meng Chun, Lam; Arshad, Haslina; Prabuwono, Anton Satria; Tan, Siok Yee; Kahaki, S. M.M.

In: Multimedia Tools and Applications, 22.09.2017, p. 1-32.

Research output: Contribution to journalArticle

@article{0f8f6c81e7c540bd86b346fa6469c91e,
title = "Interaction techniques in desktop virtual environment: the study of visual feedback and precise manipulation method",
abstract = "Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the object less precise. This paper investigated two new interaction techniques in a virtual environment. It describes the influence of natural and non-natural virtual feedback in the selection process using the GITDVR-G interaction technique, which consists of a grasping visual feedback. The GITDVR-G was evaluated in a virtual knee surgery training system. The results showed that it was effective in terms of the task completion time, and that the participants preferred the natural grasping visual feedback. Besides that, the precise manipulation in a newly-designed interaction technique (Precise GITDVR-G) was evaluated. The Precise GITDVR-G includes a normal manipulation mode and a precise manipulation mode that can be triggered by hand gestures. During the precise manipulation mode, an inset view will appear and move with the selected object to provide a better view to users, while the movements of the virtual hand are scaled down to improve the precision. Four different configurations of the precise manipulation technique were evaluated, and the results showed that the unimanual control method with an inset view performed better in terms of the task performance time and the subjective feedback. The finding suggested that the realistic virtual grasping visual feedback can be applied in a virtual hand interaction technique, and that the inset view feature is helpful in the precise manipulation.",
keywords = "Hand gesture, Interaction technique, Virtual grasping, Virtual training system",
author = "{Meng Chun}, Lam and Haslina Arshad and Prabuwono, {Anton Satria} and Tan, {Siok Yee} and Kahaki, {S. M.M.}",
year = "2017",
month = "9",
day = "22",
doi = "10.1007/s11042-017-5205-9",
language = "English",
pages = "1--32",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Interaction techniques in desktop virtual environment

T2 - the study of visual feedback and precise manipulation method

AU - Meng Chun, Lam

AU - Arshad, Haslina

AU - Prabuwono, Anton Satria

AU - Tan, Siok Yee

AU - Kahaki, S. M.M.

PY - 2017/9/22

Y1 - 2017/9/22

N2 - Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the object less precise. This paper investigated two new interaction techniques in a virtual environment. It describes the influence of natural and non-natural virtual feedback in the selection process using the GITDVR-G interaction technique, which consists of a grasping visual feedback. The GITDVR-G was evaluated in a virtual knee surgery training system. The results showed that it was effective in terms of the task completion time, and that the participants preferred the natural grasping visual feedback. Besides that, the precise manipulation in a newly-designed interaction technique (Precise GITDVR-G) was evaluated. The Precise GITDVR-G includes a normal manipulation mode and a precise manipulation mode that can be triggered by hand gestures. During the precise manipulation mode, an inset view will appear and move with the selected object to provide a better view to users, while the movements of the virtual hand are scaled down to improve the precision. Four different configurations of the precise manipulation technique were evaluated, and the results showed that the unimanual control method with an inset view performed better in terms of the task performance time and the subjective feedback. The finding suggested that the realistic virtual grasping visual feedback can be applied in a virtual hand interaction technique, and that the inset view feature is helpful in the precise manipulation.

AB - Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the object less precise. This paper investigated two new interaction techniques in a virtual environment. It describes the influence of natural and non-natural virtual feedback in the selection process using the GITDVR-G interaction technique, which consists of a grasping visual feedback. The GITDVR-G was evaluated in a virtual knee surgery training system. The results showed that it was effective in terms of the task completion time, and that the participants preferred the natural grasping visual feedback. Besides that, the precise manipulation in a newly-designed interaction technique (Precise GITDVR-G) was evaluated. The Precise GITDVR-G includes a normal manipulation mode and a precise manipulation mode that can be triggered by hand gestures. During the precise manipulation mode, an inset view will appear and move with the selected object to provide a better view to users, while the movements of the virtual hand are scaled down to improve the precision. Four different configurations of the precise manipulation technique were evaluated, and the results showed that the unimanual control method with an inset view performed better in terms of the task performance time and the subjective feedback. The finding suggested that the realistic virtual grasping visual feedback can be applied in a virtual hand interaction technique, and that the inset view feature is helpful in the precise manipulation.

KW - Hand gesture

KW - Interaction technique

KW - Virtual grasping

KW - Virtual training system

UR - http://www.scopus.com/inward/record.url?scp=85029741284&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029741284&partnerID=8YFLogxK

U2 - 10.1007/s11042-017-5205-9

DO - 10.1007/s11042-017-5205-9

M3 - Article

SP - 1

EP - 32

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

ER -