Survey of Small Targets Detection Technology in Optical Imaging

doi:10.3969/j.issn.1009-086x.2020.05.010

Abstract

Abstract: Small targets detection in optical imaging is a difficult problem in the field of computer vision.At the same time,with the expansion of imaging distance and the requirements of long range strikes and rapid attack/defense in modern warfare,there will be a lot of realistic needs for small targets detection.Therefore,how to quickly and accurately detect small targets in complex backgrounds is of great significance in areas such as intelligent control,visual navigation,and target monitoring.Reviews the research situation of infrared small targets detection,visible small targets detection and small targets detection based on deep learning in recent years at home and abroad,in order to seek new exploration and breakthrough,as well as provide useful reference for the development of small targets detection technology.

Key words: small target detection, infrared image, visible image, image enhancement, transform domain, deep learning

摘要： 光学成像中的小目标检测是计算机视觉领域的研究难点。同时,伴随成像距离拓展以及现代战争远程打击、快速攻防的要求,必将产生大量小目标检测的现实需求。因此,如何在复杂背景中快速、准确地检测小目标,对智能控制、视觉导航以及目标监测等领域都具有重要意义。从红外小目标检测、可见光小目标检测、基于深度学习的小目标检测3个方面综述了近年来国内外相关领域的研究情况,以期在此基础上寻求新的探索和突破,为小目标检测技术的发展提供有益参考。

关键词: 小目标检测, 红外图像, 可见光图像, 图像增强, 变换域, 深度学习

CLC Number:

WANG Zhi-hu, SHEN Xiao-qing, GUI Wei-long. Survey of Small Targets Detection Technology in Optical Imaging[J]. Modern Defense Technology, 2020, 48(5): 67-73.

王志虎, 沈小青, 桂伟龙. 光学成像小目标检测技术综述[J]. 现代防御技术, 2020, 48(5): 67-73.

References

[1] 田鹏辉,隋立春,燕莎.红外运动小目标检测方法综述[J].探测与控制学报,2013,35(2):76-80.
TIAN Peng-hui,SUI Li-chun,YAN sha.A Review on Infrared Small Moving Target Detection[J].Journal of Detection & Control,2013,35(2):76-80.
[2] 白婷.基于视觉显著性的红外小目标检测算法研究[D].武汉:华中科技大学,2016.
BAI Ting.Research Algorithms of Infrared Small Target Detection Based on Visual Saliency[D].Wuhan:Huazhong University of Science & Technology,2016.
[3] WANG Ping,TIAN Jin-wen,GAO Chen-qiang.Infrared Small Target Detection Using Directional High-pass Filters Based on LS-SVM[J].Electronics Letters,2009,45(3):156-158.
[4] DENG He,WEI Yan-tao,TONG Ming-wen.Small Target Detection Based on Weighted Self-Information Map[J].Infrared Physics & Technology,2013,60(2):197-206.
[5] Bae Tae-Wuk.Small Target Detection Using Bilateral Filter and Temporal Cross Product in Infrared Images[J].Infrared Physics & Technology,2011,54(5):403-411.
[6] GU Yan-feng,WANG Chen,LIU Bao-xue,et al.A Kernel-Based Nonparametric Regression Method for Clutter Removal in Infrared Small-Target Detection Applications[J].IEEE Geoscience and Remote Sensing Letters,2010,7(3):469-473.
[7] YANG L,YANG J,YANG K.Adaptive Detection for Infrared Small Target Under Sea-sky Complex Background[J].Electronics Letters,2004,40(17):1083-1085.
[8] SADJADI F A.Infrared Target Detection with Probability Density Functions of Wavelet Transform Subbands[J].Applied Optics,2004,43(2):315-23.
[9] TOM V T,PELI T,LEUNG M,et al.Morphology-Based Algorithm for Point Target Detection in Infrared Backgrounds[C]//Optical Engineering and Photonics in Aerospace Sensing,1993:2-11.
[10] Kim Jong-Ho,Park Jun-Jae,Ahn Sang-Ho,et al.Small Target Detection Using Morphology and Modified Gaussian Distance Function[J].Security & Communication Networks,2016,9(6):555-560.
[11] ZHOU Jian-jun,LÜ Hao-yin,ZHOU Fu-gen.Infrared Small Target Enhancement by Using Sequential Top-Hat Filters[C]//International Symposium on Optoelectronic Technology and Application 2014:Image Processing and Pattern Recognition.International Society for Optics and Photonics,2014:93011L-93011L-5.
[12] LI Wei,PAN Chun-hong,LIU Li-xiong.Saliency-Based Automatic Target Detection in Forward Looking Infrared Images[C]//IEEE International Conference on Image Processing.IEEE,2010:957-960.
[13] WANG Xin,LÜ Guo-fang,XU Li-zhong.Infrared Dim Target Detection Based on Visual Attention[J].Infrared Physics & Technology,2012,55(6):513-521.
[14] ZHAO Ju-feng,FENG Hua-jun,XU Zhi-hai,et al.Real-Time Automatic Small Target Detection Using Saliency Extraction and Morphological Theory[J].Optics & Laser Technology,2013,47(4):268-277.
[15] WEI Yan-tao,YOU Xin-ge,LI Hong.Multiscale Patch-based Contrast Measure for Small Infrared Target Detection[J].Pattern Recognition,2016,58:216-226.
[16] WANG Yan-hua,LIU Wei-ning.DIM Target Enhancement Algorithm for Low-Contrast Image based on Anisotropic Diffusion[J].Opto-Electronic Engineering,2008,35(6):334-339.
[17] BAI Xiang-zhi,ZHOU Fu-gen,XUE Bin-dang.Fusion of Infrared and Visual Images Through Region Extraction by Using Multi Scale Center-Surround Top-hat Transform[J].Optics Express,2011,19(9):8444-8457.
[18] 陈彦.巴特沃斯高通滤波器在图像处理中的应用[J].邵阳学院学报:自然科学版,2007(2):47-50.
CHEN Yan.The Application of Butterworth High Pass Filter in Sharpening of Digital Image[J].Journal of Shaoyang University:Natural Science ed,2007(2):47-50.
[19] ARIVAZHAGAN S,GANESAN L.Automatic Target Detection Using Wavelet Transform[J].Eurasip Journal on Advances in Signal Processing,2004(17):1-12.
[20] LOU Jing,ZHU Wei,WANG Huan,et al.Small Target Detection Combining Regional Stability and Saliency in a Color Image[J].Multimedia Tools & Applications,2017,76(13):1-18.
[21] 邓鹤,魏艳涛,童名文,等.基于改进的局部反熵算子的小目标检测[J].通信学报,2013(4):60-69.
DENG He,WEI Yan-tao,TONG Ming-wen,et al.Small Target Detection Based on Modified Local Reverse Entropy Operator[J].Journal of Communications,2013(4):60-69.
[22] 李大伟.固定翼无人机地面车辆目标自动检测与跟踪[D].北京:中国科学院大学,2017.
LI Da-wei.Automatic Vehicle Detection and Tracking in Aerial Images by Fixed-wing UAV[D].Beijing:University of Chinese Academy of Sciences,2017.
[23] MUNDHENK T N,KONJEVOD G,SAKLA W A,et al.A Large Contextual Dataset for Classification,Detection and Counting of Cars with Deep Learning[C]//European Conference on Computer Vision.Springer,Cham,2016:785-800.
[24] RAZAKARIVONY S,JURIE F.Small Target Detection combining Foreground and Background Manifolds[C]//IAPR International Conference on Machine Vision Applications,Kyoto,Japan,2013.
[25] 付若楠.基于深度学习的目标检测研究[D].北京:北京交通大学,2017.
FU Ruo-nan.Research on Target Detection Based on Deep Learning[D].Beijing:Beijing Jiaotong University,2017.
[26] 王志虎.基于显著性的运动目标检测算法研究[D].北京:国防科学技术大学,2015.
WANG Zhi-Hu.Research on Moving Object Detection Based on Saliency[D].Beijing:National University of Defense Technology,2015.
[27] GIRSHICK R,DONAHUE J,DARRELL T,et al.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),Columbus,OH.2014:580-587.
[28] REDMON J,DIVVALA S,GIRSHICK R,et al.You Only Look Once:Unified,Real-Time Object Detection[C]//Computer Vision and Pattern Recognition,IEEE,2016:779-788.
[29] 王昊然.基于多层卷积特征高阶融合的多任务目标检测系统研究[D].哈尔滨:哈尔滨工业大学,2017.
WANG Hao-ran.Research of Multi-Task Detection System Based on High-order Fusion of Convolutional Feature Hierarchical Representation[D].Harbin:Harbin Institute of Technology,2017.
[30] 陈江昀.一种基于深度学习的新型小目标检测方法[J].计算机应用与软件,2017,34(10):227-231.
CHEN Jiang-yun.A New Method of Small Target Detection Based on Deep-Learning [J].Computer Applications and Software,2017,34(10):227-231.
[31] 唐聪,凌永顺,郑科栋,等.基于深度学习的多视窗SSD目标检测方法[J].2018,47(1):1-9.
TANG Cong,LING Yong-shun,ZHENG Ke-dong,ea al.Object Detection Method of Multi-View SSD Based on Deep Learning[J].Infrared and Laser Engineering,2018,47(1):1-9.
[32] TAKEKI A,TU T T,YOSHIHASHI R,et al.Combining Deep Features for Object Detection at Various Scales:Finding Small Birds in Landscape Images[J].IPSJ Transactions on Computer Vision & Applications,2016,8(1):1-7.
[33] KAMPFFMEYER M,SALBERG A B,JENSSEN R.Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition workshops,2016:1-9.
[34] 林两魁,王少游,唐忠兴.基于深度卷积神经网络的红外过采样扫描图像点目标检测方法[J].红外与毫米波学报,2018,37(2):219-226.
LIN Liang-kui,WANG Shao-you,TANG Zhong-xing.Point Target Detection in Infrared Over-Sampling Scanning Images Using Deep Convolutional Neural Net[J].Journal of Infrared and Millimeter Waves,2018,37(2):219-226.
[35] 冯小雨,梅卫,胡大帅.基于改进Faster R-CNN的空中目标检测[J].光学学报,2018,38(6):250-258.
FENG Xiao-yu,MEI Wei,HU Da-shuai.Aerial Target Detection Based on Improved Faster R-CNN[J].Acta Optica Sinica,2018,38(6):250-258.
[36] ZHU Rui,ZHANG Shi-feng,WANG Xiao-Bo,et al.ScratchDet:Exploring to Train Single-Shot Object Detectors from Scratch[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,2019:2268-2277.
[37] KISANTAL M,WOJNA Z,MURAWSKI J,et al.Augmentation for Small Object Detection[J].arXiv Preprint arXiv:1902.07296,2019.
[38] RAZAKARIVONY S,JURIE F.Vehicle Detection in Aerial Imagery:A Small Target Detection Benchmark[J].Journal of Visual Communication & Image Representation,2016,34:187-203.
[39] TANNER F,COLDER B,PULLEN C,et al.Overhead Imagery Research Data Set-an Annotated Data Library & Tools to Aid in the Development of Computer Vision Algorithms[C]//2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).IEEE,2009:1-8.
[40] GUAN Lin-ting,WU Yan,ZHAO Jun-qiao.SCAN:Semantic Context Aware Network for Accurate Small Object Detection[J].International Journal of Computational Intelligence Systems,2018,11(1):951-961.
[41] JADERBERG M,SIMONYAN K,ZISSERMAN A.Spatial Transformer Networks[C]//Advances in Neural Information Processing Systems,2015:2017-2025.