Advertisement

Journal of Central South University

, Volume 26, Issue 12, pp 3338–3350 | Cite as

RVFLN-based online adaptive semi-supervised learning algorithm with application to product quality estimation of industrial processes

  • Wei Dai (代伟)Email author
  • Jin-cheng Hu (胡金成)
  • Yu-hu Cheng (程玉虎)
  • Xue-song Wang (王雪松)
  • Tian-you Chai (柴天佑)
Article

Abstract

Direct online measurement on product quality of industrial processes is difficult to be realized, which leads to a large number of unlabeled samples in modeling data. Therefore, it needs to employ semi-supervised learning (SSL) method to establish the soft sensor model of product quality. Considering the slow time-varying characteristic of industrial processes, the model parameters should be updated smoothly. According to this characteristic, this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network (RVFLN), denoted as OAS-RVFLN. By introducing a L2-fusion term that can be seen a weight deviation constraint, the proposed algorithm unifies the offline and online learning, and achieves smoothness of model parameter update. Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy. Finally, the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product, which further verifies its effectiveness and potential of industrial application.

Key words

semi-supervised learning (SSL) L2-fusion term online adaptation random vector functional link network (RVFLN) 

基于随机权神经网络的在线自适应半监督学习算法 及其在工业过程产品质量评价中的应用

摘要

工业过程的产品质量往往难以在线检测,导致建模样本中存在大量的无标记样本,因此建立产 品质量软测量模型需要采用半监督学习(SSL)方法。工业过程通常具有慢时变特性,因此所建立的数 据模型也应随之改变参数,且具有一定的平滑性。针对这一特性,基于随机权神经网络RVFLN,提 出了一种新颖在线自适应半监督学习算法,即OAS-RVFLN。所提算法通过引入L2 融合项,采用权值 偏差约束,将离线和在线学习相统一,并使模型参数的优化问题得到平滑性。在基准测试函数和数据 集上的实验研究表明所提出的OAS-RVFLN 在学习速度和精度均优于传统方法;并将其应用于煤炭工 业的重介质选煤过程,估计产品灰分,进一步验证了其有效性以及工业应用的潜力。

关键词

半监督学习 L2 融合项 在线自适应 随机权神经网络 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    SHEN Ling, HE Jian-jun, YU Shou-yi, GUI Wei-hua. Temperature control for thermal treatment of aluminum alloy in a large-scale vertical quench furnace [J]. Journal of Central South University, 2016, 23(7): 1719–1728.CrossRefGoogle Scholar
  2. [2]
    CHAI Tian-you, QIN S J, WANG Hong. Optimal operational control for complex industrial processes [J]. Annual Reviews in Control, 2014, 38(1): 81–92.CrossRefGoogle Scholar
  3. [3]
    ZHOU Pin, DAI Wei, CHAI Tian-you. Multivariable disturbance observer based advanced feedback control design and its application to a grinding circuit [J]. IEEE Transactions on Control Systems Technology, 2014, 22(4): 1474–1485.CrossRefGoogle Scholar
  4. [4]
    ZHANG Tong, CHEN C L P, CHEN Long, XU Xiang-min, HU Bin. Design of highly nonlinear substitution boxes based on I-Ching operators [J]. IEEE Transactions on Cybernetics, 2018, 48(12): 3349–3358.CrossRefGoogle Scholar
  5. [5]
    ZHANG Jing-xin, CHEN Hao, CHEN Song-hang, HONG Xia. An improved mixture of probabilistic PCA for nonlinear data-driven process monitoring [J]. IEEE Transactions on Cybernetics, 2019, 49(1): 198–210.CrossRefGoogle Scholar
  6. [6]
    WANG David, LIU Jun, SRINIVASAN R. Data-driven soft-sensor approach for quality prediction in a refining process [J]. IEEE Transactions on Industrial Informatics, 2010, 6(1): 11–17.CrossRefGoogle Scholar
  7. [7]
    ZHOU Ping, LU Shao-wen, CHAI Tian-you. Data-driven soft-sensor modeling for product quality estimation using case-based reasoning and fuzzy-similarity rough sets [J]. IEEE Transactions on Automation Science and Engineering, 2014, 11(4): 992–1003.CrossRefGoogle Scholar
  8. [8]
    CHAPELLE O, LKOPF B S, ALEXANDER Z. Semi-supervised learning [J]. IEEE Transactions on Neural Networks, 2009, 20: 542–542.CrossRefGoogle Scholar
  9. [9]
    ZHU Xiao-jin. Semi-supervised learning literature survey [R]. Madison: University of Wisconsin, 2005.Google Scholar
  10. [10]
    PIROONSUP N, SINTHUPINYO S. Analysis of training data using clustering to improve semi-supervised self-training [J]. Knowledge-Based Systems, 2018, 143: 65–80.CrossRefGoogle Scholar
  11. [11]
    FUJINO A, UEDA N, SAITO K. A hybrid generative/discriminative classifier design for semi-supervised learning [J]. Transactions of the Japanese Society for Artificial Intelligence, 2006, 21(3): 301–309.CrossRefGoogle Scholar
  12. [12]
    JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc, 1999: 200–209.Google Scholar
  13. [13]
    BLUM A, MITCHELL T. Combining labeled and unlabeled data with co-training [C]// Proceedings of the 11th Computational Learning Theory. New York, USA: ACM Press, 1998, 98: 92–100.Google Scholar
  14. [14]
    BELKIN M, NIYOGI P. Laplacian eigenmaps and spectral techniques for embedding and clustering [J]. Advances in Neural Information Processing Systems, 2001, 14: 585–591.Google Scholar
  15. [15]
    PANICKER R C, PUTHUSSERYPADY S, SUN Ying. Adaptation in P300 brain-computer interfaces: A two-classifier cotraining approach [J]. IEEE Transactions on Biomedical Engineering, 2010, 57(12): 2927–2935.CrossRefGoogle Scholar
  16. [16]
    DASGUPTA S, LITTMAN M L, DAVID M. Pac generalization bounds for co-training [C]// Proceedings of the 14th Neural Information Processing Systems. Massachusetts: MIT Press, 2001: 1–8.Google Scholar
  17. [17]
    BALCAN M F, BLUM A, YANG K. Co-training and expansion: Towards bridging theory and practice [C]//Proceedings of the Neural Information Processing Systems. Massachusetts: MIT Press, 2004: 89–96.Google Scholar
  18. [18]
    TIAN Z, KUANG R. Global linear neighborhoods for efficient label propagation [C]// Proceedings of the 2012 SIAM International Conference on Data Mining. Philadelphia, USA: Society for Industrial and Applied Mathematics, 2013: 863–872.Google Scholar
  19. [19]
    NIE Fei-ping, XIANG Shi-ming, LIU Yun, ZHANG Chang-shui. A general-graph based semi-supervised learning with novel class discovery [J]. Neural Computing and Applications, 2010, 19(4): 549–555.CrossRefGoogle Scholar
  20. [20]
    JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th International Conference on Machine Learning. San Francisco: Margan Kaufmann Publishers Inc, 1999: 200–209.Google Scholar
  21. [21]
    UEFFING N, HAFFARI G, SARKAR A. Semi-supervised model adaptation for statistical machine translation [J]. Machine Translation, 2007, 21(2): 77–94.CrossRefGoogle Scholar
  22. [22]
    LI Yuan-qing, GUAN Cun-tai, LI Hui-qi, CHIN Zheng-yang. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system [J]. Pattern Recognition Letters, 2008, 29(9): 1285–1294.CrossRefGoogle Scholar
  23. [23]
    GOLDBERG A B, LI Ming, ZHU Xiao-jin. Online manifold regularization: a new learning setting and empirical study [C]// Proceedings of the European Conference on Machine Learning & Knowledge Discovery in Databases. Berlin: Springer-Verlag, 2008: 393–407.CrossRefGoogle Scholar
  24. [24]
    GEORGAKIS C. Design of dynamic experiments: A data-driven methodology for the optimization of time-varying processes [J]. Industrial & Engineering Chemistry Research, 2013, 52(35): 12369–12382.CrossRefGoogle Scholar
  25. [25]
    TANG Jian, YU Wen, CHAI Tian-you, ZHAO Li-jie. On-line principal component analysis with application to process modeling [J]. Neurocomputing, 2012, 82: 167–178.CrossRefGoogle Scholar
  26. [26]
    PAO Y H, TAKEFUJI Y. Functional-link net computing: Theory, system architecture, and functionalities [J]. Computer, 1992, 25(5): 76–79.CrossRefGoogle Scholar
  27. [27]
    SCARDAPANE S, WANG Dian-hui. Randomness in neural networks: An overview [J]. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2017, 7(2): 1–18.Google Scholar
  28. [28]
    GALLAGHER N B, WISE B M, BUTLER S W, WHITE D D J, BARNA G G. Development and benchmarking of multivariate statistical process control tools for a semiconductor etch process: improving robustness through model updating [J]. IFAC Proceedings Volumes, 1997, 30(9): 79–84.CrossRefGoogle Scholar
  29. [29]
    ZHANG Li-jun, XIA Xiao-hua, ZHU Bing. A dual-loop control system for dense medium coal washing processes with sampled and delayed measurements [J]. IEEE Transactions on Control Systems Technology, 2017, 25(6): 2211–2218.CrossRefGoogle Scholar

Copyright information

© Central South University Press and Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Information and Control EngineeringChina University of Mining and TechnologyXuzhouChina
  2. 2.State Key Laboratory of Synthetical Automation for Process IndustriesNortheastern UniversityShenyangChina

Personalised recommendations