Deep Learning for Knowledge-Driven Ontology Stream Prediction

Abstract

Time series prediction with data stream has been widely studied. Current deep learning methods e.g., Long Short-Term Memory (LSTM) perform well in learning feature representations from raw data. However, most of these models can narrowly learn semantic information behind the data. In this paper, we revisit LSTM from the perspective of Semantic Web, where streaming data are represented as ontology sequences. We propose a novel semantic-based neural network (STBNet) that (i) enriches the semantics of data stream with external text, and (ii) exploits the underlying semantics with background knowledge for time series prediction. Previous models mainly rely on numerical representation of values in raw data, while the proposed STBNet model creatively integrates semantic embedding into a hybrid neural network. We develop a new attention mechanism based on similarity among semantic embedding of ontology stream, and then we combine ontology stream and numerical analysis in the deep learning model. Furthermore, we also enrich ontology stream in STBNet, where Convolutional Neural Networks (CNNs) are incorporated in learning lexical representations of words in the text. The experiments show that STBNet outperforms state-of-the-art methods on stock price prediction.