A meaningful compact key frames extraction in complex video shots

Manar A. Mizher, Mei Choo Ang, Ahmad A. Mazhar

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Key frame extraction is an essential technique in the computer vision field. The extracted key frames should brief the salient events with an excellent feasibility, great efficiency, and with a high-level of robustness. Thus, it is not an easy problem to solve because it is attributed to many visual features. This paper intends to solve this problem by investigating the relationship between these features detection and the accuracy of key frames extraction techniques using TRIZ. An improved algorithm for key frame extraction was then proposed based on an accumulative optical flow with a self-adaptive threshold (AOF_ST) as recommended in TRIZ inventive principles. Several video shots including original and forgery videos with complex conditions are used to verify the experimental results. The comparison of our results with the-state-of-the-art algorithms results showed that the proposed extraction algorithm can accurately brief the videos and generated a meaningful compact count number of key frames. On top of that, our proposed algorithm achieves 124.4 and 31.4 for best and worst case in KTH dataset extracted key frames in terms of compression rate, while the-state-of-the-art algorithms achieved 8.90 in the best case.

Original languageEnglish
Pages (from-to)818-829
Number of pages12
JournalIndonesian Journal of Electrical Engineering and Computer Science
Volume7
Issue number3
DOIs
Publication statusPublished - 1 Sep 2017
Externally publishedYes

Fingerprint

Optical flows
Adaptive Threshold
Feature Detection
Optical Flow
Computer vision
Computer Vision
Count
Compression
Verify
Robustness
Experimental Results
Relationships
Vision

Keywords

  • Blocks differential
  • Frame differences
  • Lucas-Kanade
  • Optical flow
  • TRIZ

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications
  • Control and Optimization
  • Electrical and Electronic Engineering

Cite this

A meaningful compact key frames extraction in complex video shots. / Mizher, Manar A.; Ang, Mei Choo; Mazhar, Ahmad A.

In: Indonesian Journal of Electrical Engineering and Computer Science, Vol. 7, No. 3, 01.09.2017, p. 818-829.

Research output: Contribution to journalArticle

@article{b307069910b34c71a20091fe30724420,
title = "A meaningful compact key frames extraction in complex video shots",
abstract = "Key frame extraction is an essential technique in the computer vision field. The extracted key frames should brief the salient events with an excellent feasibility, great efficiency, and with a high-level of robustness. Thus, it is not an easy problem to solve because it is attributed to many visual features. This paper intends to solve this problem by investigating the relationship between these features detection and the accuracy of key frames extraction techniques using TRIZ. An improved algorithm for key frame extraction was then proposed based on an accumulative optical flow with a self-adaptive threshold (AOF_ST) as recommended in TRIZ inventive principles. Several video shots including original and forgery videos with complex conditions are used to verify the experimental results. The comparison of our results with the-state-of-the-art algorithms results showed that the proposed extraction algorithm can accurately brief the videos and generated a meaningful compact count number of key frames. On top of that, our proposed algorithm achieves 124.4 and 31.4 for best and worst case in KTH dataset extracted key frames in terms of compression rate, while the-state-of-the-art algorithms achieved 8.90 in the best case.",
keywords = "Blocks differential, Frame differences, Lucas-Kanade, Optical flow, TRIZ",
author = "Mizher, {Manar A.} and Ang, {Mei Choo} and Mazhar, {Ahmad A.}",
year = "2017",
month = "9",
day = "1",
doi = "10.11591/ijeecs.v7.i3.pp818-829",
language = "English",
volume = "7",
pages = "818--829",
journal = "Indonesian Journal of Electrical Engineering and Computer Science",
issn = "2502-4752",
publisher = "Institute of Advanced Engineering and Science (IAES)",
number = "3",

}

TY - JOUR

T1 - A meaningful compact key frames extraction in complex video shots

AU - Mizher, Manar A.

AU - Ang, Mei Choo

AU - Mazhar, Ahmad A.

PY - 2017/9/1

Y1 - 2017/9/1

N2 - Key frame extraction is an essential technique in the computer vision field. The extracted key frames should brief the salient events with an excellent feasibility, great efficiency, and with a high-level of robustness. Thus, it is not an easy problem to solve because it is attributed to many visual features. This paper intends to solve this problem by investigating the relationship between these features detection and the accuracy of key frames extraction techniques using TRIZ. An improved algorithm for key frame extraction was then proposed based on an accumulative optical flow with a self-adaptive threshold (AOF_ST) as recommended in TRIZ inventive principles. Several video shots including original and forgery videos with complex conditions are used to verify the experimental results. The comparison of our results with the-state-of-the-art algorithms results showed that the proposed extraction algorithm can accurately brief the videos and generated a meaningful compact count number of key frames. On top of that, our proposed algorithm achieves 124.4 and 31.4 for best and worst case in KTH dataset extracted key frames in terms of compression rate, while the-state-of-the-art algorithms achieved 8.90 in the best case.

AB - Key frame extraction is an essential technique in the computer vision field. The extracted key frames should brief the salient events with an excellent feasibility, great efficiency, and with a high-level of robustness. Thus, it is not an easy problem to solve because it is attributed to many visual features. This paper intends to solve this problem by investigating the relationship between these features detection and the accuracy of key frames extraction techniques using TRIZ. An improved algorithm for key frame extraction was then proposed based on an accumulative optical flow with a self-adaptive threshold (AOF_ST) as recommended in TRIZ inventive principles. Several video shots including original and forgery videos with complex conditions are used to verify the experimental results. The comparison of our results with the-state-of-the-art algorithms results showed that the proposed extraction algorithm can accurately brief the videos and generated a meaningful compact count number of key frames. On top of that, our proposed algorithm achieves 124.4 and 31.4 for best and worst case in KTH dataset extracted key frames in terms of compression rate, while the-state-of-the-art algorithms achieved 8.90 in the best case.

KW - Blocks differential

KW - Frame differences

KW - Lucas-Kanade

KW - Optical flow

KW - TRIZ

UR - http://www.scopus.com/inward/record.url?scp=85040912580&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040912580&partnerID=8YFLogxK

U2 - 10.11591/ijeecs.v7.i3.pp818-829

DO - 10.11591/ijeecs.v7.i3.pp818-829

M3 - Article

VL - 7

SP - 818

EP - 829

JO - Indonesian Journal of Electrical Engineering and Computer Science

JF - Indonesian Journal of Electrical Engineering and Computer Science

SN - 2502-4752

IS - 3

ER -