现代防御技术 ›› 2024, Vol. 52 ›› Issue (1): 41-48.DOI: 10.3969/j.issn.1009-086x.2024.01.006

• 军事智能 • 上一篇    下一篇

基于高级语义特征蒸馏的增量式连续目标检测方法

康梦雪1,2(), 张金鹏1,2, 马喆1,2, 黄旭辉1,2, 刘雅婷1,2, 宋子壮1,2   

  1. 1.中国航天科工集团智能科技研究院有限公司,北京 100043
    2.航天防务智能系统与技术科研重点实验室,北京 100043
  • 收稿日期:2022-10-11 修回日期:2023-02-16 出版日期:2024-02-28 发布日期:2024-02-21
  • 通讯作者: 马喆
  • 作者简介:康梦雪(1993-),女,北京人。工程师,博士,研究方向为认知神经科学与深度学习。E-mail:kangmengxue@hotmail.com

High-Level Semantic Distillation for Incremental and Continuous Object Detection

Mengxue KANG1,2(), Jinpeng ZHANG1,2, Zhe MA1,2, Xuhui HUANG1,2, Yating LIU1,2, Zizhuang SONG1,2   

  1. 1.Intelligent Science & Technology Academy Limited of CASIC, Beijing 100043, China
    2.Key Laboratory of Aerospace Defense Intelligent System and Technology, Beijing 100043, China
  • Received:2022-10-11 Revised:2023-02-16 Online:2024-02-28 Published:2024-02-21
  • Contact: Zhe MA

摘要:

现代防御要求智能感知算法具备复杂开放场景下增量式连续学习能力,而传统深度学习方法基于全体数据进行封闭训练,导致其应用能力和使用范围受限。现有连续学习算法面临灾难性知识遗忘问题,提出一种基于高级语义特征蒸馏的增量式连续目标检测方法,通过高级语义特征引导高价值底层特征的选择,将该特征从教师模型蒸馏到学生模型,从而有效促进旧任务知识传递,缓解灾难性知识遗忘。在公开图像数据集MS COCO上的实验表明,该方法在各类连续学习场景下的目标检测性能均超越先前最好方法,有望推动智能系统在动态开放场景下持续学习能力和自主遂行能力生成。

关键词: 连续学习, 目标检测, 知识蒸馏, 动态开放场景, 语义知识

Abstract:

Modern defence requires intelligent perception algorithms to possess incremental and continuous learning capabilities in complex open scenarios, while traditional deep learning methods are based on closed training with the entire dataset, which limits their application ability and usage scope. Existing continuous learning algorithms face the problem of catastrophic knowledge forgetting. This paper proposes for the first time an incremental continuous target detection method based on the distillation of high-level semantic features, which guides the selection of high-value underlying features through high-level semantic features and distills the feature from the teacher model to the student model, thus effectively facilitating the transfer of knowledge of the old task and alleviating catastrophic knowledge forgetting. Experiments on the public image dataset MS COCO show that this method outperforms the previous best method for target detection in all types of continuous learning scenarios, which is expected to promote the generation of continuous learning capability and autonomous attempts of intelligent systems in open-world setting.

Key words: continual learning, object detection, knowledge distillation, open-world setting, semantic knowledge

中图分类号: