Abstract
Big Data technology has discarded traditional data modeling approaches as no longer applicable to distributed data processing. It is, however, largely recognized that Big Data impose novel challenges in data and infrastructure management. Indeed, multiple components and procedures must be coordinated to ensure a high level of data quality and accessibility for the application layers, e.g., data analytics and reporting. In this paper, the third of its kind co-authored by members of IFIP WG 2.6 on Data Semantics, we propose a review of the literature addressing these topics and discuss relevant challenges for future research. Based on our literature review, we argue that methods, principles, and perspectives developed by the Data Semantics community can significantly contribute to address Big Data challenges.
Similar content being viewed by others
Notes
The IEEE Big Data Governance and Metadata Management (BDGMM) group (http://standards.ieee.org/develop/indconn/BDGMM_index.html) aims at enabling data integration among heterogeneous datasets from diversified domain repositories and makes data discoverable, accessible, and usable through an actionable standard infrastructure.
References
Zikopoulos P, Eaton C et al (2011) Understanding big data: analytics for enterprise class hadoop and streaming data. McGraw-Hill Osborne Media, New York
Ward JS, Barker A (2013) Undefined by data: a survey of big data definitions. arXiv preprint arXiv:1309.5821
Beyer MA, Laney D (2012) The importance of big data: a definition. Gartner, Stamford, pp 2014–2018
Laney D (2001) 3d data management: controlling data volume, velocity and variety. META Gr Res Note 6:70
Hashem IAT, Yaqoob I, Anuar NB, Mokhtar S, Gani A, Khan SU (2015) The rise of "big data" on cloud computing: review and open research issues. Inf Syst 47:98–115
Wamba SF, Akter S, Edwards A, Chopin G, Gnanzou D (2015) How big data can make big impact: findings from a systematic review and a longitudinal case study. Int J Prod Econ 165:234–246 [Online]. http://www.sciencedirect.com/science/article/pii/S0925527314004253. Accessed 20 Feb 2018
Madden S (2012) From databases to big data. IEEE Internet Comput 16(3):4–6
Amazon A (2016) Amazon 2016 [Online]. https://aws.amazon.com. 2016-01-06
Hadoop A (2009) Hadoop [Online]. http://hadoop.apache.org. 2009-03-06
Chen H, Chiang RH, Storey VC (2012) Business intelligence and analytics: from big data to big impact. MIS Q 36(4):1165–1188
Wu X, Zhu X, Wu G-Q, Ding W (2014) Data mining with big data. IEEE Trans Knowl Data Eng 26(1):97–107
Hilbert M (2016) Big data for development: a review of promises and challenges. Dev Policy Rev 34(1):135–174
Assunç ao MD, Calheiros RN, Bianchi S, Netto MA, Buyya R, (2015) Big data computing and clouds: trends and future directions. J Parallel Distrib Comput 79:3–15
Markl V (2014) Breaking the chains: on declarative data analysis and data independence in the big data era. Proc VLDB Endow 7(13):1730–1733
Damiani E, Oliboni B, Quintarelli E, Tanca L (2003) Modeling semistructured data by using graph-based constraints. OTM confederated international conferences "On the move to meaningful internet systems". Springer, Berlin, pp 20–21
Poole J, Chang D, Tolbert D, Mellor D (2003) Common warehouse metamodel. Developer’s guide, Wiley, Hoboken
Ardagna C, Asal R, Damiani E, Vu Q (2015) From security to assurance in the cloud: a survey. ACM Comput Surv: CSUR 48(1):2:1–2:50
Wilkinson MD, Dumontier M, Aalbersberg IJ, Appleton G, Axton M, Baak A, Blomberg N, Boiten J-W, da Silva Santos LB, Bourne PE et al (2016) The fair guiding principles for scientific data management and stewardship. Sci Data 3:160018
Aberer K, Catarci T, Cudré-Mauroux P, Dillon T, Grimm S, Hacid M-S, Illarramendi A, Jarrar M, Kashyap V, Mecella M et al (2004) Emergent semantics systems. Semantics of a networked world. Semantics for grid databases. Springer, Berlin, pp 14–43
Cudré-Mauroux P, Aberer K, Abdelmoty AI, Catarci T, Damiani E, Illaramendi A, Jarrar M, Meersman R, Neuhold EJ, Parent C et al (2006) Viewpoints on emergent semantics. In: Spaccapietra S, Aberer K, Cudré-Mauroux P (eds) Journal on data semantics VI. Springer, Berlin, pp 1–27
Ardagna CA, Ceravolo P, Damiani E (2016) Big data analytics as-a-service: Issues and challenges. In: IEEE International conference on Big Data (Big Data). IEEE, pp 3638–3644
Chen M, Mao S, Liu Y (2014) Big data: a survey. Mob Netw Appl 19(2):171–209
Azzini A, Ceravolo P (2013) Consistent process mining over big data triple stores. In: IEEE international congress on Big Data (BigData Congress). IEEE, pp 54–61
Woods WA (1975) What’s in a link: foundations for semantic networks. In: Representation and understanding. Elsevier, pp 35–82
Franklin MJ, Halevy AY, Maier D (2005) From databases to dataspaces: a new abstraction for information management. SIGMOD Rec 34(4):27–33 [Online]. https://doi.org/10.1145/1107499.1107502
Smith K, Seligman L, Rosenthal A, Kurcz C, Greer M, Macheret C, Sexton M, Eckstein A (2014) Big metadata: the need for principled metadata management in big data ecosystems. In: Proceedings of workshop on data analytics in the Cloud, series DanaC’14. ACM, New York, pp 13:1–13:4 [Online]. https://doi.org/10.1145/2627770.2627776
Waller MA, Fawcett SE (2013) Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. J Bus Logist 34(2):77–84
Borkar V, Carey MJ, Li C (2012) Inside big data management: ogres, onions, or parfaits? In: Proceedings of the 15th international conference on extending database technology. ACM, pp 3–14
White T (2012) Hadoop: the definitive guide. O’Reilly Media Inc, Sebastopol
Jagadish H (2015) Big data and science: myths and reality. Big Data Res 2(2):49–52
Pääkkönen P, Pakkala D (2015) Reference architecture and classification of technologies, products and services for big data systems. Big Data Res 2(4):166–186
Ardagna C, Bellandi V, Bezzi M, Ceravolo P, Damiani E, Hebert C (June 2017) A model-driven methodology for big data analytics-as-a-service. In: Proceedings of BigData Congress, Honolulu. HI, USA
Labrinidis A, Jagadish HV (2012) Challenges and opportunities with big data. Proc VLDB Endow 5(12):2032–2033. https://doi.org/10.14778/2367502.2367572
Ardagna CA, Bellandi V, Bezzi M, Ceravolo P, Damiani E, Hebert C (2018) Model-based big data analytics-as-a-service: take big data to the next level. IEEE Trans Serv Comput PP(99):1–1
Liao C, Squicciarini A (2015) Towards provenance-based anomaly detection in mapreduce. In: 15th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGrid), vol 2015. IEEE, pp 647–656
Duggan J, Elmore AJ, Stonebraker M, Balazinska M, Howe B, Kepner J, Madden S, Maier D, Mattson T, Zdonik S (2015) The BigDAWG polystore system. SIGMOD Rec 44(2):11–16
Sowmya R, Suneetha K (2017) Data mining with big data. In: 11th international conference on intelligent systems and control (ISCO). IEEE, pp 246–250
Zhou W, Mapara S, Ren Y, Li Y, Haeberlen A, Ives Z, Loo BT, Sherr M (2012) Distributed time-aware provenance. In: Proceedings of the VLDB endowment, vol 6, no 2. VLDB Endowment, pp 49–60
Akoush S, Sohan R, Hopper A (2013) Hadoopprov: towards provenance as a first class citizen in mapreduce. In: TaPP
Glavic B (2014) Big data provenance: challenges and implications for benchmarking. In: Rabl T, Poess M, Baru C, Jacobsen H-A (eds) Specifying big data benchmarks. Springer, Berlin, Heidelberg, pp 72–80
Berti-Equille L, Ba ML (2016) Veracity of big data: challenges of cross-modal truth discovery. J. Data Inf Qual 7(3):12:1–12:3
Kläs M, Putz W, Lutz T (2016) Quality evaluation for big data: a scalable assessment approach and first evaluation results. In: 2016 joint conference of the international workshop on software measurement and the international conference on software process and product measurement (IWSM-MENSURA). IEEE, pp 115–124
Daiber J, Jakob M, Hokamp C, Mendes PN (2013) Improving efficiency and accuracy in multilingual entity extraction. In: Proceedings of the 9th international conference on semantic systems. ACM, pp 121–124
Shin J, Wu S, Wang F, De Sa C, Zhang C, Ré C (July 2015) Incremental knowledge base construction using DeepDive. Proc VLDB Endow 8(11), 1310–1321. ISSN 2150-8097. https://doi.org/10.14778/2809974.2809991
Chiticariu L, Krishnamurthy R, Li Y, Raghavan S, Reiss FR, Vaithyanathan S (2010) Systemt: an algebraic approach to declarative information extraction. In: Proceedings of the association for computational linguistics, pp 128–137
Fuhring P, Naumann F (2007) Emergent data quality annotation and visualization [Online]. https://hpi.de/fileadmin/user_upload/fachgebiete/naumann/publications/2007/Emergent_Data_Quality_Annotation_and_Visualization.pdf. Accessed 20 Feb 2018
Bondiombouy C, Kolev B, Levchenko O, Valduriez P (2016) Multistore big data integration with CloudMdsQL. In: Hameurlain A, Küng J, Wagner R, Chen Q (eds) Transactions on large-scale data-and knowledge-centered systems XXVIII: special issue on database-and expert-systems applications. Springer, Berlin, Heidelberg, pp 48–74. https://doi.org/10.1007/978-3-662-53455-7_3
Bergamaschi S, Beneventano D, Mandreoli F, Martoglia R, Guerra F, Orsini M, Po L, Vincini M, Simonini G, Zhu S , Gagliardelli L, Magnotta L (2018) From data integration to big data integration. In: Flesca S, Greco S, Masciari E, Saccà D (eds) A comprehensive guide through the Italian database research over the last 25 years. Springer, Cham, pp 43–59
Ramakrishnan R, Sridharan B, Douceur JR, Kasturi P, Krishnamachari-Sampath B, Krishnamoorthy K, Li P, Manu M, Michaylov S, Ramos R et al (2017) Azure data lake store: a hyperscale distributed file service for big data analytics. In: Proceedings of the 2017 ACM international conference on management of data. ACM, pp 51–63
Masseroli M, Kaitoua A, Pinoli P, Ceri S (2016) Modeling and interoperability of heterogeneous genomic big data for integrative processing and querying. Methods 111:3–11
Scannapieco M, Virgillito A, Zardetto D (2013) Placing big data in official statistics: a big challenge? In: Proceedings of NTTS (new techniques and technologies for statistics), March 5–7, Brussels
Gualtieri M, Hopkins B (2014) SQL-For-Hadoop: 14 capable solutions reviewed. Forrester
Liu H, Kumar TA, Thomas JP (2015) Cleaning framework for big data-object identification and linkage. In: IEEE international congress on Big Data (BigData Congress). IEEE, pp 215–221
Gulzar MA, Interlandi M, Han X, Li M, Condie T, Kim M (2017) Automated debugging in data-intensive scalable computing. In: Proceedings of the 2017 symposium on cloud computing, series SoCC ’17. ACM, New York, pp 520–534 [Online]. https://doi.org/10.1145/3127479.3131624
de Wit T (2017) Using AIS to make maritime statistics. In: Proceedings of NTTS (New techniques and technologies for statistics), March 14–16, Brussels
Zardetto D, Scannapieco M, Catarci T (2010) Effective automated object matching. In: Proceedings of the 26th international conference on data engineering, ICDE 2010, March 1-6, Long Beach, California, USA, pp 757–768
Xin RS, Gonzalez JE, Franklin MJ, Stoica I (2013) Graphx: a resilient distributed graph system on spark. In: First international workshop on graph data management experiences and systems, GRADES 2013, co-loated with SIGMOD/PODS, New York, NY, USA, June 24, p 2 [Online]. http://event.cwi.nl/grades2013/02-xin.pdf. Accessed 20 Feb 2018
Junghanns M, Petermann A, Gómez K, Rahm E (2015) GRADOOP: scalable graph data management and analytics with hadoop. CoRR [Online]. arxiv:1506.00548
Yu J, Wu J, Sarwat M (2015) Geospark: a cluster computing framework for processing large-scale spatial data. In: Proceedings of the 23rd SIGSPATIAL international conference on advances in geographic information systems, Bellevue, WA, USA, November 3–6, pp 70:1–70:4 [Online]. https://doi.org/10.1145/2820783.2820860
You S, Zhang J, Gruenwald L (2015) Large-scale spatial join query processing in cloud. In: 31st IEEE international conference on data engineering workshops, ICDE workshops 2015, Seoul, South Korea, April 13–17, pp 34–41. [Online]. https://doi.org/10.1109/ICDEW.2015.7129541
Saleh O, Hagedorn S, Sattler K (2015) Complex event processing on linked stream data. Datenbank Spektrum 15(2):119–129
Kornacker M, Behm A, Bittorf V, Bobrovytsky T, Ching C, Choi A, Erickson J, Grund M, Hecht D, Jacobs M, Joshi I, Kuff L, Kumar D, Leblang A, Li N, Pandis I, Robinson H, Rorke D, Rus S, Russell J, Tsirogiannis D, Wanderman-Milne S, Yoder M (2015) Impala: a modern, open-source SQL engine for hadoop. In: CIDR 2015, seventh biennial conference on innovative data systems research, Asilomar, CA, USA, January 4–7, Online proceedings, 2015 [Online]. http://www.cidrdb.org/cidr2015/Papers/CIDR15_Paper28.pdf
Costea A, Ionescu A, Raducanu B, Switakowski M, Bârca C, Sompolski J, Luszczak A, Szafranski M, de Nijs G, Boncz PA (2016) Vectorh: taking sql-on-hadoop to the next level. In: Proceedings of the 2016 international conference on management of data, SIGMOD conference 2016, San Francisco, CA, USA, June 26–July 01, pp 1105–1117 [Online]. https://doi.org/10.1145/2882903.2903742
Schätzle A, Przyjaciel-Zablocki M, Skilevic S, Lausen G (2016) S2RDF: RDF querying with SPARQL on spark. PVLDB 9(10):804–815 [Online]. http://www.vldb.org/pvldb/vol9/p804-schaetzle.pdf
Cudré-Mauroux P, Enchev I, Fundatureanu S, Groth PT, Haque A, Harth A, Keppmann FL, Miranker DP, Sequeda J, Wylot M (2013) Nosql databases for RDF: an empirical evaluation. In: The semantic Web—ISWC 2013—12th international semantic web conference, Sydney, NSW, Australia, October 21–25, Proceedings, Part II, 2013, pp 310–325 [Online]. https://doi.org/10.1007/978-3-642-41338-4_20
Appice A, Ceci M, Malerba D (2018) Relational data mining in the era of big data. In: Flesca S, Greco S, Masciari E, Saccà D (eds) A comprehensive guide through the Italian database research over the last 25 years. Springer, cham, pp 323–339. https://doi.org/10.1007/978-3-319-61893-7_19
Khare S, An K, Gokhale AS, Tambe S, Meena A (2015) Reactive stream processing for data-centric publish/subscribe. In: Proceedings of the 9th international conference on distributed event-based systems (DEBS). ACM, pp 234–245
Poggi F, Rossi D, Ciancarini P, Bompani L (2016) Semantic run-time models for self-adaptive systems: a case study. In: 2016 IEEE 25th international conference on enabling technologies: infrastructure for collaborative enterprises (WETICE). IEEE, pp 50–55
Um J-H, Lee S, Kim T-H, Jeong C-H, Song S-K, Jung H (2016) Semantic complex event processing model for reasoning research activities. Neurocomputing 209:39–45
Giese M, Soylu A, Vega-Gorgojo G, Waaler A, Haase P, Jiménez-Ruiz E, Lanti D, Rezk M, Xiao G, Özçep Ö et al (2015) Optique: zooming in on big data. Computer 48(3):60–67
Unece big data quality framework [Online]. http://www1.unece.org/stat/platform/display/bigdata/2014+Project. Accessed 20 Feb 2018
Severin J, Lizio M, Harshbarger J, Kawaji H, Daub CO, Hayashizaki Y, Bertin N, Forrest AR, Consortium F et al (2014) Interactive visualization and analysis of large-scale sequencing datasets using zenbu. Nat Biotechnol 32(3):217–219
Mezghani E, Exposito E, Drira K, Da Silveira M, Pruski C (2015) A semantic big data platform for integrating heterogeneous wearable data in healthcare. J Med Syst 39(12):185
Ginsberg J, Mohebbi M, Patel R, Brammer L, Smolinski M, Brilliant L (2009) Detecting influenza epidemics using search engine query data. Nature 457(7232):1012–1014
Sculley D, Holt G, Golovin D, Davydov E, Phillips T, Ebner D, Chaudhary V, Young M, Crespo J-F, Dennison D (2015) Hidden technical debt in machine learning systems. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems 28, Curran Associates, Inc., pp 2503–2511. http://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf
Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE (2008) Bigtable: a distributed storage system for structured data. ACM Trans Comput Syst 26(2):4:1–4:26. https://doi.org/10.1145/1365815.1365816
Suriarachchi I, Plale B (2016) Provenance as essential infrastructure for data lakes. In: Proceedings of international workshop on provenance and annotation of data and processes. LNCS 9672
Terrizzano I, Schwarz P, Roth M, Colino JE (2015) Data wrangling: the challenging journey from the wild to the lake. In: Proceedings of conference on innovative data systems research (CIDR)
Teradata (2014) Putting the data lake to work: a guide to best practices. http://www.teradata.com/Resources/Best-Practice-Guides/Putting-the-Data-Lake-to-Work-A-Guide-to-Bes. Accessed on 20 June 2017 [Online]
Batini C, Scannapieco M (2016) Data and information quality—dimensions. Principles and techniques, series. In: Data-centric systems and applications. Springer
Agrawal D, Bernstein P, Bertino E, Davidson S, Dayal U, Franklin M, Gehrke J, Haas L, Halevy A, Han J et al (2011) Challenges and opportunities with big data. Purdue University, Cyber Center Technical Reports
Liu M, Wang Q (2016) Rogas: a declarative framework for network analytics. Proceedings of international conference on very large data bases (VLDB) 9(13):1561–1564
Hasan O, Habegger B, Brunie L, Bennani N, Damiani E (2013) A discussion of privacy challenges in user profiling with big data techniques: the EEXCESS use case. In: IEEE international congress on Big Data (BigData Congress). IEEE, pp 25–30
Doan A, Ardalan A, Ballard JR, Das S, Govind Y, Konda P, Li H, Paulson E, Zhang H et al (2017) Toward a system building agenda for data integration. arXiv preprint arXiv:1710.00027
Flood M, Grant J, Luo H, Raschid L, Soboroff I, Yoo K (2016) Financial entity identification and information integration (feiii) challenge: the report of the organizing committee. In: Proceedings of the second international workshop on data science for macro-modeling. ACM, p 1
Haryadi AF, Hulstijn J, Wahyudi A, Van Der Voort H, Janssen M (2016) Antecedents of big data quality: an empirical examination in financial service organizations. In: IEEE international conference on Big Data (Big Data). IEEE, pp 116–121
Benedetti F, Beneventano D, Bergamaschi S (2016) Context semantic analysis: a knowledge-based technique for computing inter-document similarity. Springer International Publishing, Berlin, pp 164–178
Ford E, Carroll JA, Smith HE, Scott D, Cassell JA (2016) Extracting information from the text of electronic medical records to improve case detection: a systematic review. J Am Med Inform Assoc 23(5):1007–1015. https://doi.org/10.1093/jamia/ocv180
Haas D, Krishnan S, Wang J, Franklin MJ, Wu E (2015) Wisteria: nurturing scalable data cleaning infrastructure. Proc VLDB Endow 8(12):2004–2007. https://doi.org/10.14778/2824032.2824122
Cabot J, Toman D, Parsons J, Pastor O, Wrembel R (2016) Big data and conceptual models: are they mutually compatible? In: International conference on conceptual modeling (ER), panel discussion [Online]. http://er2016.cs.titech.ac.jp/program/panel.html. Accessed 20 Feb 2018
Voigt M, Pietschmann S, Grammel L, Meißner K (2012) Context-aware recommendation of visualization components. In: Proceedings of the 4th international conference on information, process, and knowledge management. Citeseer, pp 101–109
Soylu A, Giese M, Jimenez-Ruiz E, Kharlamov E, Zheleznyakov D, Horrocks I (2013) OptiqueVQS: towards an ontology-based visual query system for big data. In: Proceedings of the fifth international conference on management of emergent digital ecosystems, series, MEDES ’13. ACM, New York, pp 119–126 [Online]. https://doi.org/10.1145/2536146.2536149
McKenzie G, Janowicz K, Gao S, Yang J-A, Hu Y (2015) POI pulse: a multi-granular, semantic signature-based information observatory for the interactive visualization of big geosocial data. Cartographica Int J Geogr Inf Geovis 50(2):71–85
Habib MB, Van Keulen (2016) TwitterNEED: a hybrid approach for named entity extraction and disambiguation for tweet. Nat Lang Eng 22(3):423–456. https://doi.org/10.1017/S1351324915000194
Magnani M, Montesi D (2010) A survey on uncertainty management in data integration. JDIQ 2(1):5:1–5:33. https://doi.org/10.1145/1805286.1805291
van Keulen M (2012) Managing uncertainty: the road towards better data interoperability. Inf Technol: IT 54(3):138–146. https://doi.org/10.1524/itit.2012.0674
Andrews P, Kalro A, Mehanna H, Sidorov A (2016) Productionizing machine learning pipelines at scale. In: Machine learning systems workshop at ICML
Sparks ER, Venkataraman S, Kaftan T, Franklin MJ, Recht B (2017) Keystoneml: optimizing pipelines for large-scale advanced analytics. In: 2017 IEEE 33rd international conference on data engineering (ICDE), pp 535–546
Meng X, Bradley J, Yavuz B, Sparks E, Venkataraman S, Liu D, Freeman J, Tsai D, Amde M, Owen S et al (2016) Mllib: machine learning in apache spark. J Mach Learn Res 17(1):1235–1241
Böse J-H, Flunkert V, Gasthaus J, Januschowski T, Lange D, Salinas D, Schelter S, Seeger M, Wang Y (2017) Probabilistic demand forecasting at scale. Proc VLDB Endow 10(12):1694–1705
Baylor D, Breck E, Cheng H-T, Fiedel N, Foo CY, Haque Z, Haykal S, Ispir M, Jain V, Koc L et al (2017) Tfx: a tensorflow-based production-scale machine learning platform. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1387–1395
Ardagna C, Ceravolo P, Cota GL, Kiani MM, Damiani E (2017) What are my users looking for when preparing a big data campaign. In: IEEE international congress on Big Data (BigData Congress). IEEE, pp 201–208
Palmér C (2017) Modelling eu directive 2016/680 using enterprise architecture
Atzmueller M, Kluegl P, Puppe F (2008) Rule-based information extraction for structured data acquisition using textmarker. In: Proceedings of LWA, pp 1–7
Settles B (2011) Closing the loop: fast, interactive semi-supervised annotation with queries on features and instances. In: Proceedings of EMNLP.ACL, pp 1467–1478
Müller C, Strube M (2006) Multi-level annotation of linguistic data with MMAX2. Corpus Technol Lang Pedag New Resour New Tools New Methods 3:197–214
Stenetorp P, Pyysalo S, Topić G, Ohta T, Ananiadou S, Tsujii J (2012) Brat: a web-based tool for NLP-assisted text annotation. In: Proceedings of the demonstrations at the 13th conference of the European chapter of the association for computational linguistics. Association for Computational Linguistics, Stroudsburg, PA, USA, pp 102–107
Auer S, Bizer C, Kobilarov G, Lehmann J, Cyganiak R, Ives Z (2007) DBpedia: a nucleus for a web of open data. In: Aberer K, Choi K-S, Noy N, Allemang D, Lee K, Nixon L, Golbeck J, Mika P, Maynard D, Mizoguchi R, Schreiber G, Cudré-Mauroux P (eds) The semantic web. Springer, Berlin, Heidelberg, pp 722–735
Bizer C, Heath T, Berners-Lee T (2009) Linked data–the story so far. Int J Semant Web Inf Syst: IJSWIS 5(3):1–22
Benikova D, Biemann C (2016) Semreldata ? Multilingual contextual annotation of semantic relations between nominals: dataset and guidelines. In: LREC
Lu A, Wang W, Bansal M, Gimpel K, Livescu K (2015) Deep multilingual correlation for improved word embeddings. In: NAACL-HLT
Pecina P, Toral A, Way A, Papavassiliou V, Prokopidis P, Giagkou M (2011) Towards using web-crawled data for domain adaptation in statistical machine translation. In: The 15th conference of the European association for machine translation (EAMT)
Yasseri T, Spoerri A, Graham M, Kertész J (2014) The most controversial topics in Wikipedia: a multilingual and geographical analysis. In: Fichman P, Hara N (eds) Global Wikipedia: international and cross-cultural issues in online collaboration. Rowman & Littlefield Publishers Inc, Lanham, pp 25–48
Micher JC (2012) Improving domain-specific machine translation by constraining the language model. Army Research Laboratory, Technical Report of ARL-TN-0492
D’Haen J, den Poel DV, Thorleuchter D, Benoit D (2016) Integrating expert knowledge and multilingual web crawling data in a lead qualification system. Decis Support Syst 82:69–78
Helou MA, Palmonari M, Jarrar M (2016) Effectiveness of automatic translations for cross-lingual ontology mapping. J Artif Int Res 55(1):165–208
Furno D, Loia V, Veniero M, Anisetti M, Bellandi V, Ceravolo P, Damiani E (2011) Towards an agent-based architecture for managing uncertainty in situation awareness. In: 2011 IEEE symposium on intelligent agent (IA). IEEE, pp 1–6
Dalvi N, Ré C, Suciu D (2009) Probabilistic databases: diamonds in the dirt. Commun ACM 52(7):86–94. https://doi.org/10.1145/1538788.1538810
Ceravolo P, Damiani E, Fugazza C (2007) Trustworthiness-related uncertainty of semantic web-style metadata: a possibilistic approach. In: ISWC workshop on uncertainty reasoning for the semantic web (URSW), vol 327 [Sn], pp 131–132
Panse F, van Keulen M, Ritter N (2013) Indeterministic handling of uncertain decisions in deduplication. JDIQ 4(2):91–925. https://doi.org/10.1145/2435221.2435225
Abedjan Z, Golab L, Naumann F (2015) Profiling relational data: a survey. VLDB J 24(4):557–581. https://doi.org/10.1007/s00778-015-0389-y
Papenbrock T, Ehrlich J, Marten J, Neubert T, Rudolph J-P, Schönberg M, Zwiener J, Naumann F (2015) Functional dependency discovery: an experimental evaluation of seven algorithms. Proc VLDB Endow 8(10):1082–1093
Chen CLP, Zhang C (2014) Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf Sci 275:314–347
Naumann F (2014) Data profiling revisited. SIGMOD Rec 42(4):40–49
Ahmadov A, Thiele M, Eberius J, Lehner W, Wrembel R (2015) Towards a hybrid imputation approach using web tables. In: IEEE/ACM international symposium on big data computing (BDC), pp 21–30
Ahmadov A, Thiele M, Lehner W, Wrembel R (2017) Context similarity for retrieval-based imputation. In: International symposium on foundations and applications of big data analytics (FAB) (to appear)
Li Z, Sharaf MA, Sitbon L, Sadiq S, Indulska M, Zhou X (2014) A web-based approach to data imputation. World Wide Web 17(5):873–897
Miao X, Gao Y, Guo S, Liu W (2018) Incomplete data management: a survey. Front Comput Sci 12(1):4–25. https://doi.org/10.1007/s11704-016-6195-x
Wiederhold G (1992) Mediators in the architecture of future information systems. IEEE Comput 25(3):38–49
Tonon A, Demartini G, Cudré-Mauroux P (2012) Combining inverted indices and structured search for ad-hoc object retrieval. In: The 35th international ACM SIGIR conference on research and development in information retrieval, SIGIR ’12, Portland, OR, USA, August 12-16, pp 125–134 [Online]. https://doi.org/10.1145/2348283.2348304
Catasta M, Tonon A, Demartini G, Ranvier J, Aberer K, Cudré-Mauroux P (2014) B-hist: entity-centric search over personal web browsing history. J Web Semant 27:19–25 [Online]. https://doi.org/10.1016/j.websem.2014.07.003
Flood M, Jagadish HV, Raschid L (2016) Big data challenges and opportunities in financial stability monitoring. Financ Stab Rev 20:129–142
Ni LM, Tan H, Xiao J (2016) Rethinking big data in a networked world. Front Comput Sci 10(6):965–967
Kolb L, Thor A, Rahm E (2012) Dedoop: efficient deduplication with hadoop. PVLDB 5(12):1878–1881
Ghemawat S, Gobioff H, Leung S (2003) The google file system. In: Proceedings of the 19th ACM symposium on operating systems principles 2003, SOSP 2003, Bolton Landing, NY, USA, October 19–22, pp 29–43 [Online]. https://doi.org/10.1145/945445.945450
Dittrich J, Quiané-Ruiz J, Richter S, Schuh S, Jindal A, Schad J (2012) Only aggressive elephants are fast elephants. PVLDB 5(11):1591–1602 [Online]. http://vldb.org/pvldb/vol5/p1591_jensdittrich_vldb2012.pdf
Carbone P, Katsifodimos A, Ewen S, Markl V, Haridi S, Tzoumas K (2015) Apache flink™: stream and batch processing in a single engine. IEEE Data Eng Bull 38(4):28–38 [Online]. http://sites.computer.org/debull/A15dec/p28.pdf
Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauly M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In: Proceedings of the 9th USENIX symposium on networked systems design and implementation, NSDI 2012, San Jose, CA, USA, April 25–27, pp 15–28 [Online]. https://www.usenix.org/conference/nsdi12/technical-sessions/presentation/zaharia. Accessed 20 Feb 2018
Armbrust M, Xin RS, Lian C, Huai Y, Liu D, Bradley JK, Meng X, Kaftan T, Franklin MJ, Ghodsi A, Zaharia M (2015) Spark SQL: relational data processing in spark. In: Proceedings of the 2015 ACM SIGMOD international conference on management of data, Melbourne, Victoria, Australia, May 31–June 4, pp 1383–1394 [Online]. https://doi.org/10.1145/2723372.2742797
Hagedorn S, Götze P, Sattler K (2017) The STARK framework for spatio-temporal data analytics on spark. In: Datenbanksysteme für Business, Technologie und Web (BTW, 17. Fachtagung des GI-Fachbereichs, Datenbanken und Informationssysteme" (DBIS), 6.-10. März 2017. Stuttgart, Germany, Proceedings, pp 123–142
Meng X, Bradley JK, Yavuz B, Sparks ER, Venkataraman S, Liu D, Freeman J, Tsai D B, Amde M, Owen S, Xin D, Xin R, Franklin MJ, Zadeh R, Zaharia M, Talwalkar A (2016) Mllib: machine learning in apache spark. J Mach Learn Res 17:34:1–34:7 [Online]. http://jmlr.org/papers/v17/15-237.html
Abouzeid A, Bajda-Pawlikowski K, Abadi DJ, Rasin A, Silberschatz A (2009) Hadoopdb: an architectural hybrid of mapreduce and DBMS technologies for analytical workloads. PVLDB 2(1):922–933 [Online]. http://www.vldb.org/pvldb/2/vldb09-861.pdf
Du J, Wang H, Ni Y, Yu Y (2012) Hadooprdf: a scalable semantic data analytical engine. In: Intelligent computing theories and applications—8th international conference, ICIC 2012, Huangshan, China, July 25–29. Proceedings, pp 633–641 [Online]. https://doi.org/10.1007/978-3-642-31576-3_80
Schätzle A, Przyjaciel-Zablocki M, Neu A, Lausen G (2014) Sempala: interactive SPARQL query processing on hadoop. In: The semantic Web—ISWC 2014—13th international semantic web conference, Riva del Garda, Italy, October 19–23. Proceedings, Part I, pp 164–179 [Online]. https://doi.org/10.1007/978-3-319-11964-9_11
Ladwig G, Harth A (2011) Cumulusrdf: linked data management on nested key-value stores. In: Proceedings of the 7th international workshop on scalable semantic web knowledge base systems (SSWS2011) at the 10th international semantic web conference (ISWC2011). Oktober 2011, Inproceedings
Corbellini A, Mateos C, Zunino A, Godoy D, Schiaffino S (2017) Persisting big-data: the NoSQL landscape. Inf Syst 63:1–23
Barbará D (2002) Requirements for clustering data streams. SIGKDD Explor Newsl 3(2):23–27. https://doi.org/10.1145/507515.507519
Gama J, Aguilar-Ruiz J (2007) Knowledge discovery from data streams. Intell Data Anal 11(1):1–2
Meir-Huber M, Köhler M (2014) Big data in Austria. Austrian Ministry for Transport, Innovation and Technology (BMVIT), Technical report
Nural MV, Peng H, Miller JA (2017) Using meta-learning for model type selection in predictive big data analytics. In: 2017 IEEE international conference on Big Data (Big Data). IEEE, pp 2027–2036
Cunha T, Soares C, de Carvalho AC (2018) Metalearning and recommender systems: a literature review and empirical study on the algorithm selection problem for collaborative filtering. Inf Sci 423:128–144
Blair G, Bencomo N, France R (2009) Models@ run.time. Computer 42(10):22–27
Schmid S, Gerostathopoulos I, Prehofer C, Bures T (2017) Self-adaptation based on big data analytics: a model problem and tool. In: IEEE/ACM 12th international symposium on software engineering for adaptive and self-managing systems (SEAMS). IEEE, pp 102–108
Hartmann T, Moawad A, Fouquet F, Nain G, Klein J, Traon YL (2015) Stream my models: reactive peer-to-peer distributed models@run.time. In: Proceedings of the 18th international conference on model driven engineering languages and systems (MoDELS). ACM/IEEE
van der Aalst W, Damiani E (2015) Processes meet big data: connecting data science with process science. IEEE Trans Serv Comput 8(6):810–819
Luckham DC (2001) The power of events: an introduction to complex event processing in distributed enterprise systems. Addison-Wesley, Boston
van der Aalst WMP (2012) Process mining. Commun ACM 55(8):76–83
van der Aalst WMP, Adriansyah A, de Medeiros AKA, Arcieri F, Baier T, Blickle T, Bose RPJC, van den Brand P, Brandtjen R, Buijs JCAM, Burattin A, Carmona J, Castellanos M, Claes J, Cook J, Costantini N, Curbera F, Damiani E, de Leoni M, Delias P, van Dongen BF, Dumas M, Dustdar S, Fahland D, Ferreira DR, Gaaloul W, van Geffen F, Goel S, Günther CW, Guzzo A, Harmon P, ter Hofstede AHM, Hoogland J, Ingvaldsen JE, Kato K, Kuhn R, Kumar A, Rosa ML, Maggi FM, Malerba D, Mans RS, Manuel A, McCreesh M, Mello P, Mendling J, Montali M, Nezhad H R M, zur Muehlen M, Munoz-Gama J, Pontieri L, Ribeiro J, Rozinat A, Pérez HS, Pérez RS, Sepúlveda M, Sinur J, Soffer P, Song M, Sperduti A, Stilo G, Stoel C, Swenson KD, Talamo M, Tan W, Turner C, Vanthienen J, Varvaressos G, Verbeek E, Verdonk M, Vigo R, Wang J, Weber B, Weidlich M, Weijters T, Wen L, Westergaard M, Wynn MT (2011) Process mining manifesto. In: Proceedings of the business process management workshops (BPM). Springer, pp 169–194
Dumas M, van der Aalst WMP, ter Hofstede AHM (2005) Process-aware information systems: bridging people and software through process technology. Wiley, Hoboken
van Dongen BF, van der Aalst WMP (2005) A meta model for process mining data. In: Proceedings of the international workshop on enterprise modelling and ontologies for interoperability (EMOI) co-located with the 17th conference on advanced information systems engineering (CAiSE)
Al-Ali H, Damiani E, Al-Qutayri M, Abu-Matar M, Mizouni R (2016) Translating bpmn to business rules. In: International symposium on data-driven process discovery and analysis. Springer, pp 22–36
Hripcsak G, Rothschild AS (2005) Agreement, the f-measure, and reliability in information retrieval. J Am Med Inform Assoc 12(3):296–298
Gilson O, Silva N, Grant PW, Chen M (2008) From web data to visualization via ontology mapping. Coput Graph Forum 27(3):959–966. https://doi.org/10.1111/j.1467-8659.2008.01230.x
Nazemi K, Burkhardt D, Breyer M, Stab C, Fellner DW (2010) Semantic visualization cockpit: adaptable composition of semantics-visualization techniques for knowledge-exploration. In: International association of online engineering (IAOE): international conference interactive computer aided learning, pp 163–173
Nazemi K, Breyer M, Forster J, Burkhardt D, Kuijper A (2011) Interacting with semantics: a user-centered visualization adaptation based on semantics data. In: Smith MJ, Salvendy G (eds) Human interface and the management of information. Interacting with information. Springer, Berlin, Heidelberg pp 239–248
Melo C, Mikheev A, Le-Grand B, Aufaure M-A (2012) Cubix: a visual analytics tool for conceptual and semantic data. In: IEEE 12th international conference on data mining workshops (ICDMW). IEEE, pp 894–897
Fluit C, Sabou M, Van Harmelen F (2006) Ontology-Based information visualization: toward semantic web applications. In: Geroimenko V, Chen C (eds) Visualizing the semantic Web: XML-Based internet and information visualization. Springer, London, pp 45–58. https://doi.org/10.1007/1-84628-290-X_3
Krivov S, Williams R, Villa F (2007) Growl: a tool for visualization and editing of owl ontologies. Web Semant Sci Serv Agents World Wide Web 5(2):54–57
Chu D, Sheets DA, Zhao Y, Wu Y, Yang J, Zheng M, Chen G (2014) Visualizing hidden themes of taxi movement with semantic transformation. In: Visualization symposium (PacificVis), IEEE pacific. IEEE, pp 137–144
Catarci T, Scannapieco M, Console M, Demetrescu C (2017) My (fair) big data. In: 2017 IEEE international conference on Big Data, BigData 2017, Boston, MA, USA, December 11–14, pp 2974–2979 [Online]. https://doi.org/10.1109/BigData.2017.8258267
Oracle (2015) The five most common big data integration mistakes to avoid, white paper. http://er2016.cs.titech.ac.jp/program/panel.html. Accessed 20 June 2017 [Online]
Ali SMF, Wrembel R (2017) From conceptual design to performance optimization of ETL workflows: current state of research and open problems. VLDB J. [Online]. https://doi.org/10.1007/s00778-017-0477-2
Olston C, Reed B, Srivastava U, Kumar R, Tomkins A (2008) Pig latin: a not-so-foreign language for data processing. In: Proceedings of the ACM SIGMOD international conference on management of data, SIGMOD, Vancouver, BC, Canada, June 10–12, pp 1099–1110 [Online]. https://doi.org/10.1145/1376616.1376726
Venkataraman S, Yang Z, Liu D, Liang E, Falaki H, Meng X, Xin R, Ghodsi A, Franklin MJ, Stoica I, Zaharia M (2016) Sparkr: scaling R programs with spark. In: Proceedings of the 2016 international conference on management of data, SIGMOD conference 2016, San Francisco, CA, USA, June 26–July 01, pp 1099–1104 [Online]. https://doi.org/10.1145/2882903.2903740
Dinter B, Gluchowski P, Schieder C (2015) A stakeholder lens on metadata management in business intelligence and big data-results of an empirical investigation
Yazici A, George R (1999) Fuzzy database modeling, ser. Studies in fuzziness and soft computing. Physica Verlag, vol 26. iSBN 978-3-7908-1171-1
Shafer G (1976) A mathematical theory of evidence. Princeton University Press, Princeton
Wanders B, van Keulen M, van der Vet P (2015) Uncertain groupings: probabilistic combination of grouping data. In: Proceedings of DEXA, ser. LNCS, vol 9261. Springer, pp 236–250. https://doi.org/10.1007/978-3-319-22849-5_17
Huang J, Antova L, Koch C, Olteanu D (2009) MayBMS: a probabilistic database management system. In: Proceedings of SIGMOD. ACM, pp 1071–1074. https://doi.org/10.1145/1559845.1559984
Thiele M, Fischer U, Lehner W (2009) Partition-based workload scheduling in living data warehouse environments. Inf Syst 34(4–5):382–399
Angelini M, Santucci G (2013) Modeling incremental visualizations. In: Proceedings of the EuroVis workshop on visual analytics (EuroVA13), pp 13–17
Schulz H-J, Angelini M, Santucci G, Schumann H (2016) An enhanced visualization process model for incremental visualization. IEEE Trans Vis Comput Graph 22(7):1830–1842
Stolper CD, Perer A, Gotz D (2014) Progressive visual analytics: user-driven visual exploration of in-progress analytics. IEEE Trans Vis Comput Graph 20(12):1653–1662
Fekete J-D, Primet R (2016) Progressive analytics: a computation paradigm for exploratory data analysis. arXiv preprint arXiv:1607.05162
Shneiderman B, Aris A (2006) Network visualization by semantic substrates. IEEE Trans Vis Comput Graph 12(5):733–740
Wu D, Greer MJ, Rosen DW, Schaefer D (2013) Cloud manufacturing: strategic vision and state-of-the-art. J Manuf Syst 32(4):564–579
Martin KE (2015) Ethical issues in the big data industry. MIS Q Exec 14:2
Acknowledgements
This research was partially supported by the European Union’s Horizon 2020 research and innovation programme under the TOREADOR project, Grant Agreement No. 688797. The work of R. Wrembel is supported from the National Science Center Grant No. 2015/19/B/ST6/02637.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ceravolo, P., Azzini, A., Angelini, M. et al. Big Data Semantics. J Data Semant 7, 65–85 (2018). https://doi.org/10.1007/s13740-018-0086-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13740-018-0086-2