HE L. Key Target Person Detection and Tracking Based on Fragmented Video Information[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2023

NAVIGATE

STATISTICS

Viewed178

Downloads214

HE L. Key Target Person Detection and Tracking Based on Fragmented Video Information[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2023

PDF下载 (214)

[1]MA Liuyang,HU Zhengzheng,LI Wuhua.HE L. Key Target Person Detection and Tracking Based on Fragmented Video Information[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2023[J].Journal of Zhengzhou University (Engineering Science),2024,45(pre):2-.[doi:10.13705/j.issn.1671-6833.2025.01.017]

Copy

Journal of Zhengzhou University (Engineering Science)[ISSN 1671-6833/CN 41-1339/T] Volume: 45 Number of periods: 2024 pre Page number: 2- Column: Public date: 2024-11-30

Title:: HE L. Key Target Person Detection and Tracking Based on Fragmented Video Information[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2023

Author(s):: MA Liuyang1; HU Zhengzheng1; LI Wuhua1; (1. The 27th Research Institute of China Electronics Technology Group Corporation, Zhengzhou, 450047, China)

Keywords:: Augmented reality; Artificial intelligence; Time sensitive targets; Object detection; Steady state visual evoked potential; Target recognition

CLC:: R318. 04TP391. 4

DOI:: 10.13705/j.issn.1671-6833.2025.01.017

Abstract:: To address the problem of target identity (identification, ID) fluctuation during target tracking, affecting the time-sensitive target recognition, this study proposed an "detection-decision" time-sensitive target recognition method (AR-SSVEP-YOLOV3) that integrates augmented reality (AR) technology, steady-state visual evoked potentials (SSVEP), and YOLOv3. The target perception module obtains the front-end scene video and presents it in real-time through an AR headset. The YOLOv3 algorithm completes the detection of sensitive targets in the scene video, and the AR-SSVEP EEG processing module decodes the EEG data of the subject during ID changes to identify time-sensitive targets. The correct recognition rate of time-sensitive targets is compared and analyzed, and the average improvement in the recognition rate of AR-SSVEP-YOLOV3 time-sensitive target recognition method compared to the YOLOv3 algorithm is about 40%, and the average improvement compared to the YOLOv3-Sort algorithm is about 15%. The experimental results show that the AR-SSVEP-YOLOV3 time-sensitive target recognition method can reduce the influence of target ID fluctuation on time-sensitive target recognition and improve the human-computer interaction ability and the correct recognition rate of time-sensitive targets.

References:: [1] 吴晗, 张志龙, 李楚为, 等. 时敏目标的类型与瞄准点识别算法[J]. 航空兵器, 2022,29(2):24-29.

WU H, ZHANG Z L , Li C W , et al . Recognition Algorithm for Types and Aiming Point of the Time －Sensitive Targets[J]. Aero Weaponry , 2022 ,29(2):24－29.

[2] GURKAN B. Robust object tracking via integration of particle filtering with deep detection[J]. Digital Signal Processing, 2019,87:112-124.

[3] CHEN J, LIN Y, HUANG D, et al. Robust tracking algorithm for infrared target via correlation filter and particle filter - ScienceDirect[J]. Infrared Physics & Technology, 2020,111: 103516-.

[4] 周孟然, 李学松, 朱梓伟, 等. 井下矿工多目标检测与跟踪联合算法[J]. 工矿自动化, 2022,48(10):40-47.

ZHOU M R,LI X S, ZHU Z W, et al. A joint algorithm of multi-target detection and tracking for underground miners[J]. Journal of Mine Automation, 2022,48(10):40-47.

[5] 黄培荣, 宋剑, 李楠. 打击时敏目标的决策任务层次分解[J]. 计算机与数字工程, 2014,42(10):1905-1907.

HUANG P R, SONG J,LI N. Decision-making task hierarchical decomposition of blowing time sensitive target[J]. Computer & Digital Engineering, 2014, 42(10):1905-0907.

[6] ARPAIA P, DURACCIO L, MOCCALDI N, et al. Wearable brain–computer interface instrumentation for robot-based rehabilitation by augmented reality[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(9): 6362–6371.

[7] 黄章瑞. 情境驱动的AR--BCI脑机交互方法研究[D]. 郑州大学计算机技术, 2021.

HUANG Z R. Research on Situations drive Brain-·Computer Interaction based on AR-BCI [D]. Zhengzhou: Zhengzhou University , 2021.

[8] 蒋永玉. 假手脑控的增强现实视觉刺激范式及其异步应用系统研究[D]. 西安交通大学, 2022.

JIANG Y Y. Research on Augmented-Reality Visually Stimulus Paradigm and Its Asynchronous BCI System for Prosthetic Hands [D], Xi’an: Xi’an Jiaotong University, 2022

[9] FANG B, DING W, SUN F, et al. Brain-Computer Interface Integrated With Augmented Reality for Human-Robot Interaction[J]. IEEE transactions on cognitive and developmental systems, 2022,15(4):1702-1711.

[10] ZHANG R, CAO L, XU Z, et al. Improving AR-SSVEP Recognition Accuracy Under High Ambient Brightness Through Iterative Learning[J]. IEEE Trans Neural Syst Rehabil Eng, 2023,31:1796-1806.

[11] 邹霞. 基于SSVEP的脑机接口系统设计与研究[D]. 南昌大学通信与信息系统, 2014.

ZOU X. Design and research of brain-computer interface system based on SSVEP[D], Nanchang: Nanchang University, 2014.

[12] 白雪鹏. 基于改进YOLO V5算法的遮挡行人检测应用研究[D]. 大连交通大学, 2023.

BAI X P. Improved YOLO V5 Algorithm based on Obscured Pedestrian Detection Application Research[D]. Dalian: Dalian Jiaotong University, 2023

[13] 院老虎, 常玉坤, 刘家夫. 基于改进YOLOv5s的雾天场景车辆检测方法[J]. 郑州大学学报（工学版）, 2023,44(3):35-41.

YUAN L H, CHANG Y K, LIU J F. Vehicle detection method based on improved YOLOv5s in foggy scene[J]. Journal of Zhengzhou University (Engineering Science), 2023,44(3):35-41.

[14] 李北明, 金荣璐, 徐召飞, 等. 基于特征蒸馏的改进Ghost-YOLOv5红外目标检测算法[J]. 郑州大学学报:工学版, 2022,43(1):7.

LI B M, JIN R L, XU Z F, et al. An improved Ghost-YOLOv5 infrared target detection algorithm based on feature distillation[J]. Journal of Zhengzhou University (Engineering Science), 2022,43(01):20-26.

[15] HORII S, N AKAUCHI S . AR-SSVEP for brain-machine interface: Estimating user’s gaze in head-mounted display with USB camera: 2015 IEEE Virtual Reality (VR)[C], 2015.

[16] HAKIM S ,JIMMY P ,CAMILLE J, et al. Towards BCI-based Interfaces for Augmented Reality: Feasibility, Design and Evaluation[J]. IEEE Transactions on Visualization and Computer Graphics, 2020,26(3):1608-1621.

[17] SHAO X, L IN M. Filter bank temporally local canonical correlation analysis for short time window SSVEPs classification[J]. Cognitive Neurodynamics, 2020,14(6).

[18] YIN X, L IN M. Multi-information improves the performance of CCA-based SSVEP classification[J]. Cogn Neurodyn, 2024,18(1):165-172.

[19] ZHAO X, LIU C, XU Z, et al. SSVEP Stimulus Layout Effect on Accuracy of Brain-Computer Interfaces in Augmented Reality Glasses[J]. IEEE access, 2020,8:5990-5998.

[20] WANG K, ZHAI D H, XIONG Y, et al. An MVMD-CCA Recognition Algorithm in SSVEP-Based BCI and Its Application in Robot Control[J]. IEEE transactions on neural networks and learning systems, 2022(5):33.

[21] 张力新,张裕坤,柯余峰,等.基于Hololens的增强现实脑-机接口研究[J].中国生物医学工程学报,2019,38(1):51-58.

ZHANG L X, ZHANG Y K, KE Y F, et al. A study of argument reality based brain-computer interface(AR-BCI) in Hololens[J]. Chinese Journal of Biomedical Engineering, 2019,38(1):51-58

[22] 何丽. 基于碎片化视频信息的关键目标人物检测和跟踪[D]. 南京邮电大学, 2023.

Similar References:

Memo

Last Update: 2024-10-10