Skip to main content
Log in

RVFLN-based online adaptive semi-supervised learning algorithm with application to product quality estimation of industrial processes

基于随机权神经网络的在线自适应半监督学习算法 及其在工业过程产品质量评价中的应用

  • Published:
Journal of Central South University Aims and scope Submit manuscript

Abstract

Direct online measurement on product quality of industrial processes is difficult to be realized, which leads to a large number of unlabeled samples in modeling data. Therefore, it needs to employ semi-supervised learning (SSL) method to establish the soft sensor model of product quality. Considering the slow time-varying characteristic of industrial processes, the model parameters should be updated smoothly. According to this characteristic, this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network (RVFLN), denoted as OAS-RVFLN. By introducing a L2-fusion term that can be seen a weight deviation constraint, the proposed algorithm unifies the offline and online learning, and achieves smoothness of model parameter update. Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy. Finally, the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product, which further verifies its effectiveness and potential of industrial application.

摘要

工业过程的产品质量往往难以在线检测,导致建模样本中存在大量的无标记样本,因此建立产 品质量软测量模型需要采用半监督学习(SSL)方法。工业过程通常具有慢时变特性,因此所建立的数 据模型也应随之改变参数,且具有一定的平滑性。针对这一特性,基于随机权神经网络RVFLN,提 出了一种新颖在线自适应半监督学习算法,即OAS-RVFLN。所提算法通过引入L2 融合项,采用权值 偏差约束,将离线和在线学习相统一,并使模型参数的优化问题得到平滑性。在基准测试函数和数据 集上的实验研究表明所提出的OAS-RVFLN 在学习速度和精度均优于传统方法;并将其应用于煤炭工 业的重介质选煤过程,估计产品灰分,进一步验证了其有效性以及工业应用的潜力。

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. SHEN Ling, HE Jian-jun, YU Shou-yi, GUI Wei-hua. Temperature control for thermal treatment of aluminum alloy in a large-scale vertical quench furnace [J]. Journal of Central South University, 2016, 23(7): 1719–1728.

    Article  Google Scholar 

  2. CHAI Tian-you, QIN S J, WANG Hong. Optimal operational control for complex industrial processes [J]. Annual Reviews in Control, 2014, 38(1): 81–92.

    Article  Google Scholar 

  3. ZHOU Pin, DAI Wei, CHAI Tian-you. Multivariable disturbance observer based advanced feedback control design and its application to a grinding circuit [J]. IEEE Transactions on Control Systems Technology, 2014, 22(4): 1474–1485.

    Article  Google Scholar 

  4. ZHANG Tong, CHEN C L P, CHEN Long, XU Xiang-min, HU Bin. Design of highly nonlinear substitution boxes based on I-Ching operators [J]. IEEE Transactions on Cybernetics, 2018, 48(12): 3349–3358.

    Article  Google Scholar 

  5. ZHANG Jing-xin, CHEN Hao, CHEN Song-hang, HONG Xia. An improved mixture of probabilistic PCA for nonlinear data-driven process monitoring [J]. IEEE Transactions on Cybernetics, 2019, 49(1): 198–210.

    Article  Google Scholar 

  6. WANG David, LIU Jun, SRINIVASAN R. Data-driven soft-sensor approach for quality prediction in a refining process [J]. IEEE Transactions on Industrial Informatics, 2010, 6(1): 11–17.

    Article  Google Scholar 

  7. ZHOU Ping, LU Shao-wen, CHAI Tian-you. Data-driven soft-sensor modeling for product quality estimation using case-based reasoning and fuzzy-similarity rough sets [J]. IEEE Transactions on Automation Science and Engineering, 2014, 11(4): 992–1003.

    Article  Google Scholar 

  8. CHAPELLE O, LKOPF B S, ALEXANDER Z. Semi-supervised learning [J]. IEEE Transactions on Neural Networks, 2009, 20: 542–542.

    Article  Google Scholar 

  9. ZHU Xiao-jin. Semi-supervised learning literature survey [R]. Madison: University of Wisconsin, 2005.

    Google Scholar 

  10. PIROONSUP N, SINTHUPINYO S. Analysis of training data using clustering to improve semi-supervised self-training [J]. Knowledge-Based Systems, 2018, 143: 65–80.

    Article  Google Scholar 

  11. FUJINO A, UEDA N, SAITO K. A hybrid generative/discriminative classifier design for semi-supervised learning [J]. Transactions of the Japanese Society for Artificial Intelligence, 2006, 21(3): 301–309.

    Article  Google Scholar 

  12. JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc, 1999: 200–209.

    Google Scholar 

  13. BLUM A, MITCHELL T. Combining labeled and unlabeled data with co-training [C]// Proceedings of the 11th Computational Learning Theory. New York, USA: ACM Press, 1998, 98: 92–100.

    Google Scholar 

  14. BELKIN M, NIYOGI P. Laplacian eigenmaps and spectral techniques for embedding and clustering [J]. Advances in Neural Information Processing Systems, 2001, 14: 585–591.

    Google Scholar 

  15. PANICKER R C, PUTHUSSERYPADY S, SUN Ying. Adaptation in P300 brain-computer interfaces: A two-classifier cotraining approach [J]. IEEE Transactions on Biomedical Engineering, 2010, 57(12): 2927–2935.

    Article  Google Scholar 

  16. DASGUPTA S, LITTMAN M L, DAVID M. Pac generalization bounds for co-training [C]// Proceedings of the 14th Neural Information Processing Systems. Massachusetts: MIT Press, 2001: 1–8.

    Google Scholar 

  17. BALCAN M F, BLUM A, YANG K. Co-training and expansion: Towards bridging theory and practice [C]//Proceedings of the Neural Information Processing Systems. Massachusetts: MIT Press, 2004: 89–96.

    Google Scholar 

  18. TIAN Z, KUANG R. Global linear neighborhoods for efficient label propagation [C]// Proceedings of the 2012 SIAM International Conference on Data Mining. Philadelphia, USA: Society for Industrial and Applied Mathematics, 2013: 863–872.

    Google Scholar 

  19. NIE Fei-ping, XIANG Shi-ming, LIU Yun, ZHANG Chang-shui. A general-graph based semi-supervised learning with novel class discovery [J]. Neural Computing and Applications, 2010, 19(4): 549–555.

    Article  Google Scholar 

  20. JOACHIMS T. Transductive inference for text classification using support vector machines [C]// Proceedings of the 16th International Conference on Machine Learning. San Francisco: Margan Kaufmann Publishers Inc, 1999: 200–209.

    Google Scholar 

  21. UEFFING N, HAFFARI G, SARKAR A. Semi-supervised model adaptation for statistical machine translation [J]. Machine Translation, 2007, 21(2): 77–94.

    Article  Google Scholar 

  22. LI Yuan-qing, GUAN Cun-tai, LI Hui-qi, CHIN Zheng-yang. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system [J]. Pattern Recognition Letters, 2008, 29(9): 1285–1294.

    Article  Google Scholar 

  23. GOLDBERG A B, LI Ming, ZHU Xiao-jin. Online manifold regularization: a new learning setting and empirical study [C]// Proceedings of the European Conference on Machine Learning & Knowledge Discovery in Databases. Berlin: Springer-Verlag, 2008: 393–407.

    Chapter  Google Scholar 

  24. GEORGAKIS C. Design of dynamic experiments: A data-driven methodology for the optimization of time-varying processes [J]. Industrial & Engineering Chemistry Research, 2013, 52(35): 12369–12382.

    Article  Google Scholar 

  25. TANG Jian, YU Wen, CHAI Tian-you, ZHAO Li-jie. On-line principal component analysis with application to process modeling [J]. Neurocomputing, 2012, 82: 167–178.

    Article  Google Scholar 

  26. PAO Y H, TAKEFUJI Y. Functional-link net computing: Theory, system architecture, and functionalities [J]. Computer, 1992, 25(5): 76–79.

    Article  Google Scholar 

  27. SCARDAPANE S, WANG Dian-hui. Randomness in neural networks: An overview [J]. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2017, 7(2): 1–18.

    Google Scholar 

  28. GALLAGHER N B, WISE B M, BUTLER S W, WHITE D D J, BARNA G G. Development and benchmarking of multivariate statistical process control tools for a semiconductor etch process: improving robustness through model updating [J]. IFAC Proceedings Volumes, 1997, 30(9): 79–84.

    Article  Google Scholar 

  29. ZHANG Li-jun, XIA Xiao-hua, ZHU Bing. A dual-loop control system for dense medium coal washing processes with sampled and delayed measurements [J]. IEEE Transactions on Control Systems Technology, 2017, 25(6): 2211–2218.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Dai  (代伟).

Additional information

Foundation item: Projects(61603393, 61973306) supported in part by the National Natural Science Foundation of China; Project(BK20160275) supported by the Natural Science Foundation of Jiangsu Province, China; Projects(2015M581885, 2018T110571) supported by the Postdoctoral Science Foundation of China; Project(PAL-N201706) supported by the Open Project Foundation of State Key Laboratory of Synthetical Automation for Process Industries of Northeastern University, China

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dai, W., Hu, Jc., Cheng, Yh. et al. RVFLN-based online adaptive semi-supervised learning algorithm with application to product quality estimation of industrial processes. J. Cent. South Univ. 26, 3338–3350 (2019). https://doi.org/10.1007/s11771-019-4257-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11771-019-4257-6

Key words

关键词

Navigation