论文浏览

【论文题目】A novel companion objective function for regularization of deep convolutional neural networks

【作    者】Weichen Sun, Fei Su        点击下载PDF全文

【关 键 字】Convolutional neural network, Regularization, Companion objective function, Classification

【发表刊物/会议】
    Image and Vision Computing

【摘    要】
     Regularization is an essential technique discussed in an attempt to solve the overfitting problem in deep convolutional neural networks (CNNs). In this paper, we proposed a novel companion objective function as a regularization strategy to boost the classification performance in deep CNNs. Three aspects of this companion objective function are studied. Firstly, we proposed two kinds of auxiliary supervision for convolutional filters and non-linear activations respectively in the companion objective function. Both of them enhanced the performance by aleviating the overfitting problem and auxiliary supervision for non-linear activations provided more efficiency. Secondly, regularization of auxiliary supervision in the pre-training phrase is discussed. With the assistance of auxiliary supervision, CNNs could obtain a more favorable initialization for end-to-end supervised fine-tuning. Finally, this companion objective function is verified to be compatible with other regularization strategies such as dropout and data augmentation. Experimental results on benchmark datasets (CIFAR-10 and CIFAR-100) demonstrated advantages of our proposed companion objective function as a regularization approach.

【发 表 年】2017

【发 表 月】4

【类    别】计算机视觉


Tel: 086-010-62283118 邮编:100876
地址:北京市海淀区西土城路10号北京邮电大学教二楼多媒体中心
北京市海淀区西土城路十号113#信箱
版权所有:北京邮电大学多媒体通信与模式识别研究室 京ICP证14002347号