TY - JOUR
T1 - Double relaxed broad learning system for image classification
AU - Qin, Zhenhao
AU - Yu, Dengxiu
AU - Jin, Junwei
AU - Chen, C. L.Philip
N1 - Publisher Copyright:
© 2025
PY - 2025/8/3
Y1 - 2025/8/3
N2 - The Broad Learning System (BLS), as a prominent network paradigm, has garnered significant attention across various domains in machine learning due to its remarkable efficiency and impressive performance. Nevertheless, two deficiencies exist when its variants are applied to supervised image classification tasks. First, they generally rely on rigid binary labels, which restricts the approximation procedure and fails to find the best classification margins. Second, using a single transformation matrix in graph-regularized BLS struggles to mitigate the overfitting problem. In this article, we focus on offering more freedom to the graph regularized BLS to explore appropriate margins between samples. Specifically, we learn the adaptive labels from data, and a marginalized constraint is implemented to enhance the distinguishability of the learned labels simultaneously. Subsequently, two distinct transformation matrices are employed for the graph embedding process, with the addition of a novel matrix designed to capture the similar structure between the transformations. The intra-class compactness of samples can be assured through experimental verification. Hence, a novel method named double relaxed BLS (DRBLS) is proposed. Further, with the help of the alternating direction method of multipliers, an efficient iterative approach is developed to find the closed-form solution. Experiments on diverse image classification tasks are conducted to certify the effectiveness of our method compared to state-of-the-art algorithms.
AB - The Broad Learning System (BLS), as a prominent network paradigm, has garnered significant attention across various domains in machine learning due to its remarkable efficiency and impressive performance. Nevertheless, two deficiencies exist when its variants are applied to supervised image classification tasks. First, they generally rely on rigid binary labels, which restricts the approximation procedure and fails to find the best classification margins. Second, using a single transformation matrix in graph-regularized BLS struggles to mitigate the overfitting problem. In this article, we focus on offering more freedom to the graph regularized BLS to explore appropriate margins between samples. Specifically, we learn the adaptive labels from data, and a marginalized constraint is implemented to enhance the distinguishability of the learned labels simultaneously. Subsequently, two distinct transformation matrices are employed for the graph embedding process, with the addition of a novel matrix designed to capture the similar structure between the transformations. The intra-class compactness of samples can be assured through experimental verification. Hence, a novel method named double relaxed BLS (DRBLS) is proposed. Further, with the help of the alternating direction method of multipliers, an efficient iterative approach is developed to find the closed-form solution. Experiments on diverse image classification tasks are conducted to certify the effectiveness of our method compared to state-of-the-art algorithms.
KW - Broad learning system
KW - Double relaxed
KW - Optimization
KW - Similar structure
KW - Soft labels
UR - http://www.scopus.com/inward/record.url?scp=105006878599&partnerID=8YFLogxK
U2 - 10.1016/j.knosys.2025.113765
DO - 10.1016/j.knosys.2025.113765
M3 - 文章
AN - SCOPUS:105006878599
SN - 0950-7051
VL - 324
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 113765
ER -