Enabling the Definition and Reuse of Multi-Domain Workflow-Based Data Analysis
- 1.3k Downloads
Data analysis applications have become essential to extract significant insight from heterogeneous data sources. However, their development requires technical expertise in computer science techniques like data mining, making its broad adoption by non-experts difficult. In this context, workflows have emerged as a high-level solution to define and automate the sequence of steps involved in the data analysis process, hiding the low-level computational requirements. Existing workflow systems have some difficulties related to their complexity to adapt the provided elements and their inability to reuse workflow definitions. To address these problems, a novel framework for creating customized, ready-to-use and interoperable workflow systems is proposed and prototyped in this paper. Its multi-layer architecture has been designed on the basis of the separation of concerns and the reuse of knowledge assets. As a result, the presented approach allows reducing the time-to-market and saving development costs.
KeywordsData analysis Workflow management system Process automation
Work supported by the Spanish Government, project TIN2014-55252-P.
- 1.Terminology & glossary. Technical report, WFMC-TC-1011, Workflow Management Coalition (1999)Google Scholar
- 2.Berthold, M.R., et al.: KNIME: the Konstanz information miner. In: Preisach, C., Burkhardt, H., Schmidt-Thieme, L., Decker, R. (eds.) Data Analysis, Machine Learning and Applications. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Berlin (2007)Google Scholar
- 4.Fowler, M.: Domain Specific Languages, 1st edn. Addison-Wesley, Boston (2010)Google Scholar
- 5.Hofmann, M., Klinkenberg, R.: RapidMiner: Data Mining Use Cases and Business Analytics Applications. Chapman & Hall/CRC, Boca Raton (2013)Google Scholar
- 7.Loukides, M.: What is Data Science?. O’Reilly Radar, Sebastopol (2010)Google Scholar
- 9.Roure, D.D., Goble, C., Bhagat, J., Cruickshank, D., Goderis, A., Michaelides, D., Newman, D.: myExperiment: defining the social virtual research environment. In: 4th IEEE International Conference on e-Science, pp. 182–189. IEEE Press (2008)Google Scholar
- 12.Wolstencroft, K., Haines, R., Fellows, D., Williams, A., Withers, D., Owen, S., Soiland-Reyes, S., Dunlop, I., Nenadic, A., Fisher, P., Bhagat, J., Belhajjame, K., Bacall, F., Hardisty, A., de la Hidalga, A.N., Balcazar Vargas, M.P., Sufi, S., Goble, C.: The taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucleic Acids Research 41(W1), W557–W561 (2013)CrossRefGoogle Scholar
- 13.Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3(3), 171–200 (2006)Google Scholar