Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality

Asyura A. Faudzi, Rahmita Wirza O K Rahmat, Puteri Suhaiza Sulaiman, Mohd Zamrin Dimon

    Research output: Contribution to journalArticle

    Abstract

    This research is about obtaining the realism in virtual heart surgery. Normally, novice cardiac surgeons learn the surgery by observing the experts perform the operation on a patient. The physical involvement from these novice cardiac surgeons are very minimal. As such, virtual surgery might help in simulating the cardiac surgery and provide the feeling of doing a real surgery without putting any patients' life at risk. The main challenge in virtual surgery is to ensure the 3D model of the heart is as realistic as the real heart. Currently artificial 3D heart is used in virtual cardiac surgery. In order to provide realism in the virtual surgery, MRI are used to capture the internal part of the heart and camera-captured images are used to portray the external part. The MRI slices are combined to create a 3D heart. In order to increase the accuracy of the texture mapping, the captured image are transformed into 3D points of cloud based on the depth of the surface, before they can be mapped on the 3D heart. These two types of images (MRI slices and camera captured) are taken from real patients. Here, MRI and point clouds provides accuracy and the captured images provide realism.

    Original languageEnglish
    Pages (from-to)6534-6542
    Number of pages9
    JournalARPN Journal of Engineering and Applied Sciences
    Volume10
    Issue number15
    Publication statusPublished - 2015

    Fingerprint

    Augmented reality
    Magnetic resonance imaging
    Surgery
    Cameras
    Textures

    Keywords

    • Augmented reality
    • Mapping points
    • Modeling

    ASJC Scopus subject areas

    • Engineering(all)

    Cite this

    Faudzi, A. A., Rahmat, R. W. O. K., Sulaiman, P. S., & Dimon, M. Z. (2015). Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality. ARPN Journal of Engineering and Applied Sciences, 10(15), 6534-6542.

    Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality. / Faudzi, Asyura A.; Rahmat, Rahmita Wirza O K; Sulaiman, Puteri Suhaiza; Dimon, Mohd Zamrin.

    In: ARPN Journal of Engineering and Applied Sciences, Vol. 10, No. 15, 2015, p. 6534-6542.

    Research output: Contribution to journalArticle

    Faudzi, Asyura A. ; Rahmat, Rahmita Wirza O K ; Sulaiman, Puteri Suhaiza ; Dimon, Mohd Zamrin. / Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality. In: ARPN Journal of Engineering and Applied Sciences. 2015 ; Vol. 10, No. 15. pp. 6534-6542.
    @article{62d45c78481144bdb7fdc34e33310746,
    title = "Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality",
    abstract = "This research is about obtaining the realism in virtual heart surgery. Normally, novice cardiac surgeons learn the surgery by observing the experts perform the operation on a patient. The physical involvement from these novice cardiac surgeons are very minimal. As such, virtual surgery might help in simulating the cardiac surgery and provide the feeling of doing a real surgery without putting any patients' life at risk. The main challenge in virtual surgery is to ensure the 3D model of the heart is as realistic as the real heart. Currently artificial 3D heart is used in virtual cardiac surgery. In order to provide realism in the virtual surgery, MRI are used to capture the internal part of the heart and camera-captured images are used to portray the external part. The MRI slices are combined to create a 3D heart. In order to increase the accuracy of the texture mapping, the captured image are transformed into 3D points of cloud based on the depth of the surface, before they can be mapped on the 3D heart. These two types of images (MRI slices and camera captured) are taken from real patients. Here, MRI and point clouds provides accuracy and the captured images provide realism.",
    keywords = "Augmented reality, Mapping points, Modeling",
    author = "Faudzi, {Asyura A.} and Rahmat, {Rahmita Wirza O K} and Sulaiman, {Puteri Suhaiza} and Dimon, {Mohd Zamrin}",
    year = "2015",
    language = "English",
    volume = "10",
    pages = "6534--6542",
    journal = "ARPN Journal of Engineering and Applied Sciences",
    issn = "1819-6608",
    publisher = "Asian Research Publishing Network (ARPN)",
    number = "15",

    }

    TY - JOUR

    T1 - Mapping points of cloud of single image onto MRI for 3D cardiac modeling for augmented reality

    AU - Faudzi, Asyura A.

    AU - Rahmat, Rahmita Wirza O K

    AU - Sulaiman, Puteri Suhaiza

    AU - Dimon, Mohd Zamrin

    PY - 2015

    Y1 - 2015

    N2 - This research is about obtaining the realism in virtual heart surgery. Normally, novice cardiac surgeons learn the surgery by observing the experts perform the operation on a patient. The physical involvement from these novice cardiac surgeons are very minimal. As such, virtual surgery might help in simulating the cardiac surgery and provide the feeling of doing a real surgery without putting any patients' life at risk. The main challenge in virtual surgery is to ensure the 3D model of the heart is as realistic as the real heart. Currently artificial 3D heart is used in virtual cardiac surgery. In order to provide realism in the virtual surgery, MRI are used to capture the internal part of the heart and camera-captured images are used to portray the external part. The MRI slices are combined to create a 3D heart. In order to increase the accuracy of the texture mapping, the captured image are transformed into 3D points of cloud based on the depth of the surface, before they can be mapped on the 3D heart. These two types of images (MRI slices and camera captured) are taken from real patients. Here, MRI and point clouds provides accuracy and the captured images provide realism.

    AB - This research is about obtaining the realism in virtual heart surgery. Normally, novice cardiac surgeons learn the surgery by observing the experts perform the operation on a patient. The physical involvement from these novice cardiac surgeons are very minimal. As such, virtual surgery might help in simulating the cardiac surgery and provide the feeling of doing a real surgery without putting any patients' life at risk. The main challenge in virtual surgery is to ensure the 3D model of the heart is as realistic as the real heart. Currently artificial 3D heart is used in virtual cardiac surgery. In order to provide realism in the virtual surgery, MRI are used to capture the internal part of the heart and camera-captured images are used to portray the external part. The MRI slices are combined to create a 3D heart. In order to increase the accuracy of the texture mapping, the captured image are transformed into 3D points of cloud based on the depth of the surface, before they can be mapped on the 3D heart. These two types of images (MRI slices and camera captured) are taken from real patients. Here, MRI and point clouds provides accuracy and the captured images provide realism.

    KW - Augmented reality

    KW - Mapping points

    KW - Modeling

    UR - http://www.scopus.com/inward/record.url?scp=84940061521&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84940061521&partnerID=8YFLogxK

    M3 - Article

    AN - SCOPUS:84940061521

    VL - 10

    SP - 6534

    EP - 6542

    JO - ARPN Journal of Engineering and Applied Sciences

    JF - ARPN Journal of Engineering and Applied Sciences

    SN - 1819-6608

    IS - 15

    ER -