TY - JOUR
T1 - Non-Exemplar Class-Incremental Learning by Random Auxiliary Classes Augmentation and Mixed Features
AU - Song, Ke
AU - Liang, Guoqiang
AU - Chen, Zhaojie
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 1991-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - Non-exemplar class-incremental learning refers to continual classifying of new and old classes without storing samples of old classes. Since only new class samples are available, catastrophic forgetting of old knowledge often occurs. In this paper, we propose an effective non-exemplar method called RAMF consisting of Random Auxiliary classes augmentation and Mixed Features. On the one hand, we design a novel random auxiliary classes augmentation method, where one augmentation is randomly selected from three augmentations and applied to inputs to generate augmented samples and extra class labels. By extending the data and label space, the model can learn more diverse and transferable representations, which can prevent the model from being biased towards learning task-specific features and facilitate the transfer among different tasks. In a word, when learning new tasks, the random auxiliary class augmentation will reduce the change of feature space and improve model generalization. On the other hand, we propose to replace the new features with mixed features for model optimization since only using new features will largely affect the previous representation embedded in the old feature space. Instead, by mixing new and old features, the cosine similarity is improved by reducing the angle between the current and old features, which allows for better stability over long-term incremental learning without increasing the computational complexity. We have conducted extensive experiments on three benchmarks CIFAR-100, TinyImageNet and ImageNet-Subset, where our method outperforms the state-of-the-art non-exemplar methods and is comparable to high-performance replay-based methods.
AB - Non-exemplar class-incremental learning refers to continual classifying of new and old classes without storing samples of old classes. Since only new class samples are available, catastrophic forgetting of old knowledge often occurs. In this paper, we propose an effective non-exemplar method called RAMF consisting of Random Auxiliary classes augmentation and Mixed Features. On the one hand, we design a novel random auxiliary classes augmentation method, where one augmentation is randomly selected from three augmentations and applied to inputs to generate augmented samples and extra class labels. By extending the data and label space, the model can learn more diverse and transferable representations, which can prevent the model from being biased towards learning task-specific features and facilitate the transfer among different tasks. In a word, when learning new tasks, the random auxiliary class augmentation will reduce the change of feature space and improve model generalization. On the other hand, we propose to replace the new features with mixed features for model optimization since only using new features will largely affect the previous representation embedded in the old feature space. Instead, by mixing new and old features, the cosine similarity is improved by reducing the angle between the current and old features, which allows for better stability over long-term incremental learning without increasing the computational complexity. We have conducted extensive experiments on three benchmarks CIFAR-100, TinyImageNet and ImageNet-Subset, where our method outperforms the state-of-the-art non-exemplar methods and is comparable to high-performance replay-based methods.
KW - Class-incremental learning
KW - auxiliary classes augmentation
KW - mixed feature
KW - noisy prototype
UR - http://www.scopus.com/inward/record.url?scp=85189553567&partnerID=8YFLogxK
U2 - 10.1109/TCSVT.2024.3382513
DO - 10.1109/TCSVT.2024.3382513
M3 - 文章
AN - SCOPUS:85189553567
SN - 1051-8215
VL - 34
SP - 7830
EP - 7843
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 9
ER -