Abstract
Direct online measurement on product quality of industrial processes is difficult to be realized, which leads to a large number of unlabeled samples in modeling data. Therefore, it needs to employ semi-supervised learning (SSL) method to establish the soft sensor model of product quality. Considering the slow time-varying characteristic of industrial processes, the model parameters should be updated smoothly. According to this characteristic, this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network (RVFLN), denoted as OAS-RVFLN. By introducing a L2-fusion term that can be seen a weight deviation constraint, the proposed algorithm unifies the offline and online learning, and achieves smoothness of model parameter update. Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy. Finally, the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product, which further verifies its effectiveness and potential of industrial application.
摘要
工业过程的产品质量往往难以在线检测,导致建模样本中存在大量的无标记样本,因此建立产 品质量软测量模型需要采用半监督学习(SSL)方法。工业过程通常具有慢时变特性,因此所建立的数 据模型也应随之改变参数,且具有一定的平滑性。针对这一特性,基于随机权神经网络RVFLN,提 出了一种新颖在线自适应半监督学习算法,即OAS-RVFLN。所提算法通过引入L2 融合项,采用权值 偏差约束,将离线和在线学习相统一,并使模型参数的优化问题得到平滑性。在基准测试函数和数据 集上的实验研究表明所提出的OAS-RVFLN 在学习速度和精度均优于传统方法;并将其应用于煤炭工 业的重介质选煤过程,估计产品灰分,进一步验证了其有效性以及工业应用的潜力。
Similar content being viewed by others
References
SHEN Ling, HE Jian-jun, YU Shou-yi, GUI Wei-hua. Temperature control for thermal treatment of aluminum alloy in a large-scale vertical quench furnace [J]. Journal of Central South University, 2016, 23(7): 1719–1728.
CHAI Tian-you, QIN S J, WANG Hong. Optimal operational control for complex industrial processes [J]. Annual Reviews in Control, 2014, 38(1): 81–92.
ZHOU Pin, DAI Wei, CHAI Tian-you. Multivariable disturbance observer based advanced feedback control design and its application to a grinding circuit [J]. IEEE Transactions on Control Systems Technology, 2014, 22(4): 1474–1485.
ZHANG Tong, CHEN C L P, CHEN Long, XU Xiang-min, HU Bin. Design of highly nonlinear substitution boxes based on I-Ching operators [J]. IEEE Transactions on Cybernetics, 2018, 48(12): 3349–3358.
ZHANG Jing-xin, CHEN Hao, CHEN Song-hang, HONG Xia. An improved mixture of probabilistic PCA for nonlinear data-driven process monitoring [J]. IEEE Transactions on Cybernetics, 2019, 49(1): 198–210.
WANG David, LIU Jun, SRINIVASAN R. Data-driven soft-sensor approach for quality prediction in a refining process [J]. IEEE Transactions on Industrial Informatics, 2010, 6(1): 11–17.
ZHOU Ping, LU Shao-wen, CHAI Tian-you. Data-driven soft-sensor modeling for product quality estimation using case-based reasoning and fuzzy-similarity rough sets [J]. IEEE Transactions on Automation Science and Engineering, 2014, 11(4): 992–1003.
CHAPELLE O, LKOPF B S, ALEXANDER Z. Semi-supervised learning [J]. IEEE Transactions on Neural Networks, 2009, 20: 542–542.
ZHU Xiao-jin. Semi-supervised learning literature survey [R]. Madison: University of Wisconsin, 2005.
PIROONSUP N, SINTHUPINYO S. Analysis of training data using clustering to improve semi-supervised self-training [J]. Knowledge-Based Systems, 2018, 143: 65–80.
FUJINO A, UEDA N, SAITO K. A hybrid generative/discriminative classifier design for semi-supervised learning [J]. Transactions of the Japanese Society for Artificial Intelligence, 2006, 21(3): 301–309.
JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc, 1999: 200–209.
BLUM A, MITCHELL T. Combining labeled and unlabeled data with co-training [C]// Proceedings of the 11th Computational Learning Theory. New York, USA: ACM Press, 1998, 98: 92–100.
BELKIN M, NIYOGI P. Laplacian eigenmaps and spectral techniques for embedding and clustering [J]. Advances in Neural Information Processing Systems, 2001, 14: 585–591.
PANICKER R C, PUTHUSSERYPADY S, SUN Ying. Adaptation in P300 brain-computer interfaces: A two-classifier cotraining approach [J]. IEEE Transactions on Biomedical Engineering, 2010, 57(12): 2927–2935.
DASGUPTA S, LITTMAN M L, DAVID M. Pac generalization bounds for co-training [C]// Proceedings of the 14th Neural Information Processing Systems. Massachusetts: MIT Press, 2001: 1–8.
BALCAN M F, BLUM A, YANG K. Co-training and expansion: Towards bridging theory and practice [C]//Proceedings of the Neural Information Processing Systems. Massachusetts: MIT Press, 2004: 89–96.
TIAN Z, KUANG R. Global linear neighborhoods for efficient label propagation [C]// Proceedings of the 2012 SIAM International Conference on Data Mining. Philadelphia, USA: Society for Industrial and Applied Mathematics, 2013: 863–872.
NIE Fei-ping, XIANG Shi-ming, LIU Yun, ZHANG Chang-shui. A general-graph based semi-supervised learning with novel class discovery [J]. Neural Computing and Applications, 2010, 19(4): 549–555.
JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th International Conference on Machine Learning. San Francisco: Margan Kaufmann Publishers Inc, 1999: 200–209.
UEFFING N, HAFFARI G, SARKAR A. Semi-supervised model adaptation for statistical machine translation [J]. Machine Translation, 2007, 21(2): 77–94.
LI Yuan-qing, GUAN Cun-tai, LI Hui-qi, CHIN Zheng-yang. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system [J]. Pattern Recognition Letters, 2008, 29(9): 1285–1294.
GOLDBERG A B, LI Ming, ZHU Xiao-jin. Online manifold regularization: a new learning setting and empirical study [C]// Proceedings of the European Conference on Machine Learning & Knowledge Discovery in Databases. Berlin: Springer-Verlag, 2008: 393–407.
GEORGAKIS C. Design of dynamic experiments: A data-driven methodology for the optimization of time-varying processes [J]. Industrial & Engineering Chemistry Research, 2013, 52(35): 12369–12382.
TANG Jian, YU Wen, CHAI Tian-you, ZHAO Li-jie. On-line principal component analysis with application to process modeling [J]. Neurocomputing, 2012, 82: 167–178.
PAO Y H, TAKEFUJI Y. Functional-link net computing: Theory, system architecture, and functionalities [J]. Computer, 1992, 25(5): 76–79.
SCARDAPANE S, WANG Dian-hui. Randomness in neural networks: An overview [J]. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2017, 7(2): 1–18.
GALLAGHER N B, WISE B M, BUTLER S W, WHITE D D J, BARNA G G. Development and benchmarking of multivariate statistical process control tools for a semiconductor etch process: improving robustness through model updating [J]. IFAC Proceedings Volumes, 1997, 30(9): 79–84.
ZHANG Li-jun, XIA Xiao-hua, ZHU Bing. A dual-loop control system for dense medium coal washing processes with sampled and delayed measurements [J]. IEEE Transactions on Control Systems Technology, 2017, 25(6): 2211–2218.
Author information
Authors and Affiliations
Corresponding author
Additional information
Foundation item: Projects(61603393, 61973306) supported in part by the National Natural Science Foundation of China; Project(BK20160275) supported by the Natural Science Foundation of Jiangsu Province, China; Projects(2015M581885, 2018T110571) supported by the Postdoctoral Science Foundation of China; Project(PAL-N201706) supported by the Open Project Foundation of State Key Laboratory of Synthetical Automation for Process Industries of Northeastern University, China
Rights and permissions
About this article
Cite this article
Dai, W., Hu, Jc., Cheng, Yh. et al. RVFLN-based online adaptive semi-supervised learning algorithm with application to product quality estimation of industrial processes. J. Cent. South Univ. 26, 3338–3350 (2019). https://doi.org/10.1007/s11771-019-4257-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11771-019-4257-6
Key words
- semi-supervised learning (SSL)
- L2-fusion term
- online adaptation
- random vector functional link network (RVFLN)