Swap Kernel Regression
Recent developments in the field of artificial intelligence have increased the demand for high performance computation devices. An edge device is highly restricted not only in terms of its computational power but also memory capacity. This study proposes a method that enables both inference and learning on an edge device. The proposed method involves a kernel machine that works in restricted environments by collaborating with its secondary storage system. The kernel parameters, which are not essential for calculating the output values for the upcoming inputs, are stored in the secondary storage to make space in the main memory. The essential kernel parameters stored in the secondary storage are loaded into the main memory when required. With the use of this strategy, the system can realize the recognition/regression tasks without reducing its generalization capability.
KeywordsSwap kernel regression Regression Kernel machine Softmax function General regression neural network Secondary storage
- Orabona, F., Keshet, J., Caputo, B.: The projectron: a bounded kernel-based perceptron. In: ICML 2008, pp. 720–727 (2008)Google Scholar
- Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations ICLR 2015 (2015), arXiv:1409.1556v6
- Weston, J., Chopra, S., Bordes, A.: Memory networks. In: ICLR 2015 (2015)Google Scholar
- Yamauchi, K.: An importance weighted projection method for incremental learning under unstationary environments. In: IJCNN2013: The International Joint Conference on Neural Networks 2013, pp. 1–9. The Institute of Electrical and Electronics Engineers, Inc., New York (2013). https://doi.org/10.1109/IJCNN.2013.6706779