An improved action key frames extraction algorithm for complex colour video shot summarization

Manar Abduljabbar Ahmad Mizher, Mei Choo Ang, Siti Norul Huda Sheikh Abdullah, Kok Weng Ng

Research output: Contribution to journalArticle

Abstract

Key frame extraction is one of the critical techniques in computer vision fields such as video search, video identification and video forgeries detection. The extracted key frames should be sufficient key frames that preserve main actions in a video with compact representation. The objective of this work is to improve our previous action key frames extraction algorithm (AKF) by adapting a threshold which selects action key frames as final key frames. The threshold adaptation was achieved by using the mean value, the standard deviation, and the L1- norm instead of the comparison of user summaries evaluation method to obtain a fully automatic video summarisation algorithm, and by eliminating the conditions in selecting the final key frames to reduce the complexity of the algorithm. We have validated our proposed Improved AKF on complex colour video shots instead of the simple grey level video shots. The Improved AKF algorithm was able to extract a compact number of action key frames by preventing redundant key frames, reduce processing complexity, and preserve sufficient information about the main actions in a video shot. We then evaluated the Improved AKF algorithm with the-state-of-theart algorithms in terms of compression ratio using Paul videos and Shih-Tang dataset. The evaluation results showed that the Improved AKF algorithm achieved better compression ratio and retained sufficient information in the extracted action key frames under different testing video shots. Therefore, the improved AKF algorithm is a suitable technique for applications in computer vision fields such as passive object-based video authentication systems.

Original languageEnglish
Pages (from-to)143-166
Number of pages24
JournalJournal of Information and Communication Technology
Volume18
Issue number2
Publication statusPublished - 1 Jan 2019

Fingerprint

Summarization
Color
Computer vision
Sufficient
Computer Vision
Compression
Video Summarization
User Evaluation
L1-norm
Authentication
Evaluation Method
Mean Value
Standard deviation
Testing
Processing

Keywords

  • Basic action
  • Blocks differential
  • L1-norm
  • Motion estimation
  • Optical flow

ASJC Scopus subject areas

  • Computer Science(all)
  • Mathematics(all)

Cite this

An improved action key frames extraction algorithm for complex colour video shot summarization. / Mizher, Manar Abduljabbar Ahmad; Ang, Mei Choo; Sheikh Abdullah, Siti Norul Huda; Ng, Kok Weng.

In: Journal of Information and Communication Technology, Vol. 18, No. 2, 01.01.2019, p. 143-166.

Research output: Contribution to journalArticle

@article{3eb3c70298d64f79b1a4b310c391de8a,
title = "An improved action key frames extraction algorithm for complex colour video shot summarization",
abstract = "Key frame extraction is one of the critical techniques in computer vision fields such as video search, video identification and video forgeries detection. The extracted key frames should be sufficient key frames that preserve main actions in a video with compact representation. The objective of this work is to improve our previous action key frames extraction algorithm (AKF) by adapting a threshold which selects action key frames as final key frames. The threshold adaptation was achieved by using the mean value, the standard deviation, and the L1- norm instead of the comparison of user summaries evaluation method to obtain a fully automatic video summarisation algorithm, and by eliminating the conditions in selecting the final key frames to reduce the complexity of the algorithm. We have validated our proposed Improved AKF on complex colour video shots instead of the simple grey level video shots. The Improved AKF algorithm was able to extract a compact number of action key frames by preventing redundant key frames, reduce processing complexity, and preserve sufficient information about the main actions in a video shot. We then evaluated the Improved AKF algorithm with the-state-of-theart algorithms in terms of compression ratio using Paul videos and Shih-Tang dataset. The evaluation results showed that the Improved AKF algorithm achieved better compression ratio and retained sufficient information in the extracted action key frames under different testing video shots. Therefore, the improved AKF algorithm is a suitable technique for applications in computer vision fields such as passive object-based video authentication systems.",
keywords = "Basic action, Blocks differential, L1-norm, Motion estimation, Optical flow",
author = "Mizher, {Manar Abduljabbar Ahmad} and Ang, {Mei Choo} and {Sheikh Abdullah}, {Siti Norul Huda} and Ng, {Kok Weng}",
year = "2019",
month = "1",
day = "1",
language = "English",
volume = "18",
pages = "143--166",
journal = "Journal of Information and Communication Technology",
issn = "1675-414X",
publisher = "Universiti Utara Malaysia Press",
number = "2",

}

TY - JOUR

T1 - An improved action key frames extraction algorithm for complex colour video shot summarization

AU - Mizher, Manar Abduljabbar Ahmad

AU - Ang, Mei Choo

AU - Sheikh Abdullah, Siti Norul Huda

AU - Ng, Kok Weng

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Key frame extraction is one of the critical techniques in computer vision fields such as video search, video identification and video forgeries detection. The extracted key frames should be sufficient key frames that preserve main actions in a video with compact representation. The objective of this work is to improve our previous action key frames extraction algorithm (AKF) by adapting a threshold which selects action key frames as final key frames. The threshold adaptation was achieved by using the mean value, the standard deviation, and the L1- norm instead of the comparison of user summaries evaluation method to obtain a fully automatic video summarisation algorithm, and by eliminating the conditions in selecting the final key frames to reduce the complexity of the algorithm. We have validated our proposed Improved AKF on complex colour video shots instead of the simple grey level video shots. The Improved AKF algorithm was able to extract a compact number of action key frames by preventing redundant key frames, reduce processing complexity, and preserve sufficient information about the main actions in a video shot. We then evaluated the Improved AKF algorithm with the-state-of-theart algorithms in terms of compression ratio using Paul videos and Shih-Tang dataset. The evaluation results showed that the Improved AKF algorithm achieved better compression ratio and retained sufficient information in the extracted action key frames under different testing video shots. Therefore, the improved AKF algorithm is a suitable technique for applications in computer vision fields such as passive object-based video authentication systems.

AB - Key frame extraction is one of the critical techniques in computer vision fields such as video search, video identification and video forgeries detection. The extracted key frames should be sufficient key frames that preserve main actions in a video with compact representation. The objective of this work is to improve our previous action key frames extraction algorithm (AKF) by adapting a threshold which selects action key frames as final key frames. The threshold adaptation was achieved by using the mean value, the standard deviation, and the L1- norm instead of the comparison of user summaries evaluation method to obtain a fully automatic video summarisation algorithm, and by eliminating the conditions in selecting the final key frames to reduce the complexity of the algorithm. We have validated our proposed Improved AKF on complex colour video shots instead of the simple grey level video shots. The Improved AKF algorithm was able to extract a compact number of action key frames by preventing redundant key frames, reduce processing complexity, and preserve sufficient information about the main actions in a video shot. We then evaluated the Improved AKF algorithm with the-state-of-theart algorithms in terms of compression ratio using Paul videos and Shih-Tang dataset. The evaluation results showed that the Improved AKF algorithm achieved better compression ratio and retained sufficient information in the extracted action key frames under different testing video shots. Therefore, the improved AKF algorithm is a suitable technique for applications in computer vision fields such as passive object-based video authentication systems.

KW - Basic action

KW - Blocks differential

KW - L1-norm

KW - Motion estimation

KW - Optical flow

UR - http://www.scopus.com/inward/record.url?scp=85063050990&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063050990&partnerID=8YFLogxK

M3 - Article

VL - 18

SP - 143

EP - 166

JO - Journal of Information and Communication Technology

JF - Journal of Information and Communication Technology

SN - 1675-414X

IS - 2

ER -