Abstract
Continuous Conditional Random Fields (CCRF) has been widely applied to various research domains as an efficient approach for structural regression. In previous studies, the weights of CCRF are constrained to be positive from a theoretical perspective. This paper extends the definition domains of weights of CCRF and thus introduces \(L_1\) norm to regularize CCRF, which enables CCRF to perform feature selection. We provide a plausible learning method for \(L_1\)-Regularized CCRF (\(L_1\)-CCRF) and verify its effectiveness. Moreover, we demonstrate that the proposed \(L_1\)-CCRF performs well in selecting key features related to the various customers’ power usages in Smart Grid.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andrew, G., Gao, J.: Scalable training of \(L_1\)-regularized log-linear models. In: Proceedings of the 24th International Conference on Machine Learning, pp. 33–40. ACM (2007)
Baltrusaitis, T., Banda, N., Robinson, P.: Dimensional affect recognition using continuous conditional random fields. In: IEEE Automatic Face and Gesture Recognition, pp. 1–8 (2013)
Guo, H.: Accelerated continuous conditional random fields for load forecasting. IEEE Trans. Knowl. Data Eng. 27(8), 2023–2033 (2015)
Ketter, W., Collins, J., Reddy, P., Weerdt, M.: The power trading agent competition. ERIM Report Series Reference No. ERS–004-LIS (2014)
Lafferty, J.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th International Conference on Machine Learning (ICML-2001) (2001)
Lavergne, T., Cappé, O., Yvon, F.: Practical very large scale CRFs. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 504–513. Association for Computational Linguistics (2010)
Liu, D., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Math. Program. 45(1–3), 503–528 (1989)
Ng, A.: Feature selection, \(L_1\) vs. \(L_2\) regularization, and rotational invariance. In: Proceedings of the Twenty-first International Conference on Machine Learning, pp. 78–85. ACM (2004)
Qin, T., Liu, T., Zhang, X., Wang, D., Li, H.: Global ranking using continuous conditional random fields. In: Advances in Neural Information Processing Systems, pp. 1281–1288 (2009)
Radosavljevic, V., Vucetic, S., Obradovic, Z.: Continuous conditional random fields for regression in remote sensing. In: ECAI, pp. 809–814 (2010)
Xin, X., King, I., Deng, H., Lyu, M.R.: A social recommendation framework based on multi-scale continuous conditional random fields. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 1247–1256. ACM (2009)
Yu, J., Vishwanathan, S., Günter, S., Schraudolph, N.: A quasi-newton approach to nonsmooth convex optimization problems in machine learning. J. Mach. Learn. Res. 11, 1145–1200 (2010)
Zhang, T.: Solving large scale linear prediction problems using stochastic gradient descent algorithms. In: Proceedings of the Twenty-first International Conference on Machine Learning, pp. 116–123. ACM (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, X., Ren, F., Liu, C., Zhang, M. (2016). \(L_1\)-Regularized Continuous Conditional Random Fields. In: Booth, R., Zhang, ML. (eds) PRICAI 2016: Trends in Artificial Intelligence. PRICAI 2016. Lecture Notes in Computer Science(), vol 9810. Springer, Cham. https://doi.org/10.1007/978-3-319-42911-3_67
Download citation
DOI: https://doi.org/10.1007/978-3-319-42911-3_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42910-6
Online ISBN: 978-3-319-42911-3
eBook Packages: Computer ScienceComputer Science (R0)