Real-Time Data Mining with In-Memory Database Technology
In the past, classical databases basically came in two flavors: optimized for write access (OLTP, online transaction processing) or read access (OLAP, online analytic processing). Typical data mining tasks, however, involve preprocessing, feature extraction, model training and cross-validation which cannot fully be categorized as either flavor. SAP’s in-memory database HANA stores all data cache-aware in main memory, allowing for rapid transactional and analytical access. While in common three-tier architectures (database, application server, client), computationally intensive applications run at the application server layer and data is loaded into the main memory of application servers, enterprise applications developed for or moved to HANA are more tightly integrated with the database. The main principle of application development for HANA is to execute data-intensive computations in the database close to the raw data in order to prevent expensive data movement. This shift in application design poses new challenges to the application developer: in order to utilize HANA efficiently, he has to think differently about how to design his application.We’ll address these challenges, discuss a real-world data analysis scenario and present some open questions in this area.
Unable to display preview. Download preview PDF.
- 1.Conrad, T.O.: New statistical algorithms for the analysis of mass spectrometry time-of-flight mass data with applications in clinical diagnostics. PhD thesis, Freie Universität Berlin (2008)Google Scholar
- 4.MALDI-TOF Mass Analysis (2011), http://www.protein.iastate.edu/maldi.html (last accessed on June 19, 2012)
- 5.Plattner, H.: A common database approach for OLTP and OLAP using an in-memory column database. In: Proc. 35th SIGMOD Intl. Conf. on Management of Data, SIGMOD 2009, pp. 1–2 (2009)Google Scholar
- 6.Plattner, H., Zeier, A.: In-Memory Data Management: An Inflection Point for Enterprise Applications. Springer, Heidelberg (2011)Google Scholar