Journal of Guangdong University of Technology ›› 2024, Vol. 41 ›› Issue (01): 63-68,92.doi: 10.12052/gdutxb.220179

• Computer Science and Technology • Previous Articles     Next Articles

Video Frame Anomaly Behavior Detection Based on Foreground Area Generative Adversarial Networks

Kuang Yong-nian, Wang Feng   

  1. School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China
  • Received:2022-12-01 Online:2024-01-25 Published:2024-02-01

HTML

PDF (PC)

259

Abstract: In order to improve the accuracy of video anomaly behavior detection, a new detection method based on generative adversarial networks for video foreground areas is proposed. First, the foreground and background masks of the ground truth video frame are extracted, to determine the foreground areas of the output video frames from generative adversarial networks. For the foreground areas under consideration, the foreground area peak signal-to-noise ratio (F-PSNR) is used to calculate the detection score of anomaly behaviors. The experimental results show that the proposed method can effectively improve the detection accuracy of video anomaly behaviors with a reduced detection time for the Avenue dataset, UCSD-Ped1 dataset and UCSD-Ped2 dataset.

Key words: video anomaly behavior detection, peak signal-to-noise ratio, generative adversarial networks, foreground area

CLC Number: 

  • TP391
[1] LAVEE G, RIVLIN E, RUDZSKY M. Understanding video events: a survey of methods for automatic interpretation of semantic occurrences in video [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) , 2009, 39(5): 489-504.
[2] LIU W, LUO W, LIAN D, et al. Future frame prediction for anomaly detection—a new baseline[C]//2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE Press, 2018: 6536-6545.
[3] GRUBBS F E. Procedures for detecting outlying observations in samples [J]. Technometrics, 1969, 11(1): 1-21.
[4] MAHADEVAN V, LI W X, BHALODIA V, et al. Anomaly detection in crowded scenes[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE Press, 2010: 1975-1981.
[5] KIM J, GRAUMAN K. Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE Press, 2009: 2921-2928.
[6] HASAN M, CHOI J, NEUMANN J, et al. Learning temporal regularity in video sequences[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE Press, 2016: 733-742.
[7] GONG D, LIU L, LE V, et al. Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV). New York: IEEE Press, 2019: 1705-1714.
[8] LUO W, LIU W, GAO S. Remembering history with convolutional LSTM for anomaly detection[C]//2017 IEEE International Conference on Multimedia and Expo (ICME). New York: IEEE Press, 2017: 439-444.
[9] NGUYEN T N, MEUNIER J. Anomaly detection in video sequence with appearance-motion correspondence[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV). New York: IEEE Press, 2019: 1273-1283.
[10] 李自强, 王正勇, 陈洪刚, 等. 基于外观和动作特征双预测模型的视频异常行为检测[J]. 计算机应用, 2021, 41(10): 2997-3003.
LI Z Q, WANG Z Y, CHEN H G, et al. Video abnormal behavior detection based on dual prediction model of appearance and motion features [J]. Journal of Computer Applications, 2021, 41(10): 2997-3003.
[11] WU C, SHAO S, TUNC C, et al. An explainable and efficient deep learning framework for video anomaly detection [J]. Cluster Computing, 2022, 25(4): 2715-2737.
[12] LIU C, FU R, LI Y, et al. A self-attention augmented graph convolutional clustering networks for skeleton-based video anomaly behavior detection [J]. Applied Sciences, 2021, 12(1): 4.
[13] ISOLA P, ZHU J Y, ZHOU T, et al. Image-to-image translation with conditional adversarial networks[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE Press, 2017: 1125-1134.
[14] KAEWTRAKULPONG P, BOWDEN R. Video-based surveillance systems [M]. Boston, MA: Springer, 2002. 135-144.
[15] LU C W, SHI J P, JIA J Y. Abnormal event detection at 150 FPS in MATLAB[C]//2013 IEEE International Conference on Computer Vision. New York: IEEE Press, 2013: 2720-2727.
[1] Ye Wu-jian, Gao Hai-jian, Weng Shao-wei, Gao Zhi, Wang Shan-jin, Zhang Chun-yu, Liu Yi-jun. A Two-stage Effect Rendering Method for Art Font Based on CGAN Network [J]. Journal of Guangdong University of Technology, 2019, 36(03): 47-55.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © 2017 Journal of Guangdong University of Technology
Add：729 East Dongfeng RD., Guangzhou PRC. Postcode: 510090
Tel：020-37626653,020-37626139,020-37626396
Email：xbzrb@gdut.edu.cn
Supported:Beijing Magtech