New Generation Platforms for Exploration of Crowdsourced Geo-Data
This chapter addresses two recent topics in the field of geo-information, the former more technological and the latter more scientific. On one side, there is an emerging trend of visualizing data and their changes in space and time through multidimensional geospatial clients and/or virtual globes. In the most advanced cases, these are not simply plain viewers but also allow analysis of the data by acting as “multidimensional intelligent geo-viewers”. On the other side, citizen science is providing a great momentum to the possibility of lay people taking part in scientific development. It is a new, citizen-centred paradigm which, in most cases, takes advantage of the individual and collective augmented capability of sensing the surrounding world through the sensors that we wear. The “citizen sensors” will consciously contribute to this development, either through volunteered geographic information or by being themselves an unconscious part of the data analytics, which makes use of geo-crowdsourced data to extract information in order to create a higher level understanding of natural and manmade phenomena. This chapter seeks to outline the Web technological solutions for visualizing and analyzing such data, through a summary of the current state of the art and the original applications developed by the authors.
Almost 10 years ago a new boost to the exploitation of Web-served geospatial data was given by the birth of virtual globes, and more in general multidimensional clients offering spatio-temporal visualization of geographic contents. Beyond their successful impact on the general public (Butler 2006), virtual globes introduced powerful ways not only to visualize but also to explore, analyse and process the heterogeneous and complex data generated by scientific disciplines (Blower et al. 2007).
Another big shift in the history of GIS began at almost the same time. Summarized by the term Volunteered Geographic Information or VGI (Goodchild 2007), a new era started where users have become active providers of geospatial contents. Social networking, digital photography, online mapping and mobile devices are currently fruitful sources of VGI, with OpenStreetMap (Arsanjani et al. 2015) being the most popular example of a collaborative spatial data collection project. Citizen science, outlining volunteers’ participation in the development of scientific activities (Cohn 2008), relies in many cases on VGI. This citizen-centred paradigm takes advantage of the individual augmented capability of sensing the world, which thanks to the sensors we wear can also produce vast quantities of unconsciously geo-crowdsourced data—termed by Harvey (2013) as CGI or Contributed GI (as opposed to VGI). One such example being the amount of data which is daily collected by smart phone users almost without any user control.
How mature is the bridge between virtual globes and VGI? The purpose of this chapter is to contribute to the discussion by investigating two innovative ways virtual globes can be exploited, namely as: (a) collaboration platforms for visualizing, exploring and collecting VGI; and (b) multidimensional intelligent geo-viewers providing advanced spatio-temporal visualization of citizen-sensed data. These topics are deepened through the description of two specific applications which have been recently (early 2016) developed by the authors.
The remainder of the chapter is structured as follows. Section on “Virtual Globes as the New Generation Visualization Platforms” provides a background on virtual globes which outlines their historical development, primary features and main software implementations. Next, a review is provided on virtual globe-based applications focused on the exploration of crowdsourced geo-data. The two original applications developed by the authors are then presented in section on “Applications”: a collaborative platform for managing citizen-sensed information and an intelligent geo-viewer of telecommunication data. Section on “Conclusions” concludes with the summary of the work’s contributions and directions for future research.
Virtual Globes as the New Generation Visualization Platforms
As mentioned above, virtual globes have ushered in a historical change in the way geospatial information is delivered over the Internet. This era was identified by Plewe (2007) as the fourth generation of Web Mapping applications, coming to the forefront after three different stages of 2D applications featuring an increasing level of interaction and usability. Virtual globes are software providing a 3D representation of the Earth and allowing users to explore it in a virtual environment while streaming satellite imagery, Digital Elevation Models (DEMs) and other geographic data from the Internet (Schultz et al. 2008). Unlike traditional GIS they offer users a “magic carpet ride” above the Earth surface. Users can also interact with the information represented on or above the surface, as well as manage geographic layers and optionally add their own data to create 3D mash-ups.
Key factors which enabled the birth of virtual globes include the development of high-performance graphics cards for 3D visualization (mainly driven by the video game industry), the evolution of Internet bandwidth, the increased availability of high-resolution satellite imagery (Yu and Gong 2012) and the advancements in the field of global spatial grids (Sahr et al. 2003). The success of virtual globes must be certainly attributed to Google Earth,1 which since its release in 2005 has gained an astonishing popularity among the general public. Goodchild reasonably claimed that “Just as the PC democratized computing, so systems like Google Earth will democratize GIS” (Butler 2006). In response to Google Earth ESRI released ArcGIS Explorer2 and Microsoft launched its Bing Maps Platform3 (previously Microsoft Virtual Earth), while an open source alternative—World Wind4 released by NASA—has been available since 2003.
Many features of virtual globes contributed to their popularity. Virtual globes are multi-scale, multipurpose and multidimensional, i.e. they can even provide a 4D visualization if time component is considered (Brovelli et al. 2013). Virtual globes offer high context capability while at the same time providing ease and intuitiveness of use. In turn this translates into a richer and more realistic user experience. What is more, the chance of visualizing, locating and interacting with different kinds of geospatial contents within a single 3D virtual environment has opened many possibilities for using virtual globes in a number of geo-related disciplines, including scientific ones (Brovelli and Zamboni 2012).
In addition to those mentioned above, several other virtual globe platforms have been released over the last decade. Examples are ESRI ArcGlobe,5 SkylineGlobe,6 CitySurf Globe,7 SuperMap GIS,8 EarthBrowser,9 ossimPlanet,10 QGIS Globe,11 gvSIG3D12 (based on NASA World Wind), osgEarth,13 Marble,14 Norkart Virtual Globe15 and Earth3D16. Standards like HTML5 and WebGL17 have recently made it possible to render interactive 3D graphics within Web browsers without the need of specific proprietary applications, run-time environments (e.g. Java Virtual Machine) or plugins. A new wave of WebGL-based virtual globes has thus emerged including Cesium,18 WebGL Earth,19 WebGL Globe,20 OpenWebGlobe21 (Loesch et al. 2012) and the Web-based version of World Wind22. It is out of the scope of this chapter to provide a rigorous and detailed description of the characteristics and differences between the virtual globes listed above. However, some useful classifications of virtual globes according to a number of criteria (platform-dependence, license type, type of application, geographic layers available by default, functionalities and freedom of customization) are provided by Brovelli et al. (2014). Keysers (2015) proposes a categorization of virtual globes into platforms and visualization applications: open and closed source; public and restricted access.
An emerging concept related to virtual globes is Digital Earth (DE). It was envisioned by Gore (1998) as a multi-resolution, 3D representation of the planet allowing scientists, policy-makers, students and all societal sectors to manage georeferenced information and navigate them in space and time (Brovelli et al. 2015). Though DE and virtual globes are often used as synonyms, according to Harvey (2009) DE refers to the experiences and knowledge people have, and continue to make of the world, while virtual globes represent the most viable term for discussions of DE software environment. In other words, virtual globes are not DE, but rather a point of access to DE. This is why in the growing literature on DE virtual globes are also named geobrowsers (see for example Goodchild 2008; Annoni et al. 2011; Craglia et al. 2012), thus underlining their correspondence to traditional Web browsers in searching, retrieving and organizing information, whose nature is however spatial (Jones 2007).
Virtual Globes for the Exploration of Crowdsourced Geo-Data
Despite having democratized access to geospatial information, due to their primarily commercial orientation (driven by Google Earth), virtual globes were initially considered poorly suited for scientific purposes (Craglia et al. 2008). Some years later Goodchild et al. (2012) identified some limits of the existing virtual globes compared to Gore’s vision, e.g. the inability to explore the Earth both backward and forward in time, the limited set of available data, and the user interaction which often resembled an access to a searchable catalogue rather than a real exploitation. Nonetheless, the capabilities of virtual globes described in section on “Virtual Globes as the New Generation Visualization Platforms” have made them increasingly used in a variety of scientific disciplines. At the time of writing (early 2016), examples include geology (Blenkinsop 2012; Martínez-Graña et al. 2013; Zhu et al. 2014), ecology (Guralnick et al. 2007), history and cultural heritage (Brovelli et al. 2013; Valentini et al. 2014), cartographic heritage (Brovelli et al. 2012; Gede et al. 2013), natural disasters and disaster management (Webley 2011; Tomaszewski 2011), environmental analyses and modelling (Chien and Tan 2011; Brovelli and Zamboni 2012), weather forecast (Smith and Lakshmanan 2011), instruction and education (Lindner-Fally and Zwartjes 2012; Bodzin et al. 2014), health (Stensgaard et al. 2009), landscape planning (Schroth et al. 2011) and urban studies (Nebiker et al. 2010). User functions typically include data visualization, collection, exploration, integration, validation, communication and dissemination, modelling, and decision support (Yu and Gong 2012).
In line with the main content of this chapter, the following discussion provides an overview of virtual globe applications focused on geo-data volunteered or crowdsourced by users. It is worth noting that VGI has been recognized as a key opportunity for the development of DE (Craglia et al. 2008; Annoni et al. 2011) and that even OpenStreetMap has been shown to be well-positioned within DE’s goals (Mooney and Corcoran 2014).
Elvidge and Tuttle (2008) predict the power of virtual globes in democratizing content contributions by users. Examples related to Google Earth are described such as the Maplandia gazetteer and the geotagged photos from Panoramio. Using virtual globes as pure visualization platforms to display geotagged contents from media sharing sites is still a common practice. As an example, Kisilevich et al. (2010) exploit Google Earth to produce interactive visualizations of tourist sites based on geotagged photos from Panoramio and Flickr. Similarly, Vu et al. (2015) make use of Google Earth to visualize Flickr photos for exploring tourists’ travel behaviour. Both examples lack time filtering of data.
Cooper et al. (2010) draft a questionnaire to explore the perceptions held by geographical information professionals from Africa on the use of VGI in virtual globes. Results reveal a number of pros and cons, these latter including the fact that digital divide (Norris 2001) is still a strong barrier to the democratization promoted by VGI and virtual globes. Gede et al. (2013) created a virtual museum where a WebGL-based virtual globe environment allows users to navigate digitized paper globes. Upon registration, the users can add/edit both data and descriptions, thus adding a participative nature to the collection. Wu et al. (2010) describe a 3D urban planning interoperable environment based on GeoGlobe, a virtual globe prototype developed by the authors. Both urban planning designers and the public can visualize, manipulate and discuss urban planning projects. Participation happens through the upload of urban models as well as online tools such as forums, e-mails and instant messaging. Some spatial analysis tools are also available within the platform (e.g. to compute distances and calculate/simulate sunlight and sunshade). Beltran et al. (2013) present the VisioMIMEXT application built on top of NASA World Wind which allows the user to spatially search, visualize and retrieve georeferenced media resources from diverse social networks (Twitter, OpenStreetMap, YouTube, Flickr, Geonames and Wikipedia). Time filtering of data is planned as a future extension. The authors stress the role of virtual globes as data fusion tools for both experts and the public.
Virtual globes are also recognized as useful Web-based tools for collaborative mapping. The collaborative geospatial environment described by Nebiker et al. (2007) allows integrating observations from real-world mobile geo sensors (e.g. GPS logs and UAV video streams) into a three-dimensional viewer (i3D) developed by the authors. Additional communication channels between users such as chat, video or voice are also available. Similarly, Yovcheva et al. (2010) describe the development of a geo-collaborative web-based virtual globe prototype, based on Google Earth and designed for distributed teams of environmental researchers working with spatio-temporal data.
Virtual globes are also used in remote sensing as platforms for collecting, comparing and validating land use/land cover (LULC) data. The main example is Geo-Wiki23 (Fritz et al. 2009; Fritz et al. 2012), an online Google Earth-based crowdsourcing platform where volunteers exploit high-resolution imagery to perform spatial validation of existing LULC maps. A recent paper (See et al. 2015) offers an overview of the main features of the platform together with examples on how the crowdsourced data collected through Geo-Wiki has been used to improve information on LULC. A similar system is VIEW-IT (Virtual Interpretation of Earth Web-Interface Tool), a crowdsourcing platform based on Google Earth, which allows users to collect LULC data from high-resolution imagery (Clark and Aide 2011). Another tool designed for experts to assess LULC change and validate global LULC maps is developed by Bastin et al. (2013). The platform is mainly 2D but makes also use of Google Earth to increase context capability. Depending on the area, users can visualize images at different dates using a time slider.
In contrast to the picture emerging from the literature review outlined in section on “Virtual Globes as the New Generation Visualization Platforms”, two virtual globe-based applications are presented in the following which constitute promising examples of new generation 3D/4D platforms to explore volunteered and crowdsourced data. The first, described in section on “PoliCrowd”, provides a general-purpose collaboration platform for managing observations collected from mobile devices. A multidimensional viewer of telecommunication data, based on a high-level platform for scientific data analysis, is then presented in section on “Telecommunication Data Viewer”.
The first application, named PoliCrowd24 (current version 2.0), implements a multidimensional and multi-thematic collaboration platform based on NASA World Wind virtual globe. PoliCrowd is a Web-based system able to: (a) allow citizens to perform field surveys using common mobile devices, compiling and submitting ad hoc questionnaires together with multimedia contents (images, videos, etc.), which are registered through the device sensors and georeferenced through the device positioning services (e.g. the GPS); (b) store and manage field-captured data into a spatial database and provide Web publication using standard protocols; and (c) provide a Web-based collaboration platform offering not just a 3D/4D visualization interface, but also an overall framework allowing users to manage data and create customized maps.
PoliCrowd is fully built upon existing open source software and is in turn released as open source. The two main software products exploited for the development are the Open Data Kit25 (ODK) suite for managing citizen-sensed data, and the World Wind virtual globe on which the platform is built. After a detailed description of these components, the system architecture and its main functionalities are presented in the following.
Open Data Kit (ODK)
NASA World Wind Java SDK
Used by space agencies (e.g. the ESA—European Space Agency), local and national government agencies (e.g. the US FAA—Federal Aviation Administration), commercial industry and scientific communities, NASA World Wind is based on open standards and can be configured to load and visualize the most popular spatial data formats. It is conceived to work with large amounts of data and information, all of which can be stored on local disks or remote data servers. Many satellite images are available by default including BlueMarble (BMNG 500 m), i3-Landsat (15 m), USGS Orthophoto (1 m US only), USGS Urban Area Orthophoto (0.5–0.25 m selected US cities), and MS Virtual Earth Aerial Imagery, as well as some Digital Terrain Models (DTMs) including SRTM30Plus (30 arc-sec, ~900 m), SRTM3 v2 v4.1 (3 arc-sec, ~90 m), ASTER (~30 m), and USGS NED (~30 m, ~10 m US only). Both images and DTMs are dynamically served by NASA31 and USGS32 WMSs (Web Mapping Services). Moreover, it is possible to access any OGC compliant WMS server and specific servers providing DEMs that can be superimposed onto the geoid model implemented within the platform. Finally, it is possible to locate on the globe, and in its surrounding space, both 2D objects (lines, polygons, markers, callouts and multimedia viewers) and 3D objects built up from geometric primitives (parallelepipeds, spheres, extruded polygons, etc.). The platform is suitable for any geospatial application thanks to the possibility of controlling the structure, quality and accuracy of the surface horizontal and vertical components (by varying the textures and the DTMs, respectively) and the full three-dimensional component of the virtual globe (the 2D and 3D objects that can be created for specific application scenarios).
Overview of Functionalities
After a first prototypal stage in which PoliCrowd was customized for tourism and cultural topics (Brovelli et al. 2014), the current version, PoliCrowd 2.0, represents its natural evolution with the purpose of being a completely general-purpose and multi-thematic social platform. Using a simple and intuitive graphical user interface (GUI) users can create, populate, customize and share projects, which refer to one or more specific topics integrated and displayed simultaneously within the same scenario.
POIs visualization is fully customizable thanks to a suitable layer management interface. The attributes to be displayed can be filtered out and the marker icons can be customized either by choosing them from a default collection or by uploading them manually. The application can manage different projects populated with different WMS and ODK layers. All the projects created by users are publicly accessible by design in order to promote community participation. Finally, the introduction of the fourth dimension (time) provides a more in-depth navigation through the content. The time bar enables temporal filtering of all the POIs just by picking a given date or setting a range of dates. The same capability is also available for multimedia contents, which can be independently filtered according to the date of upload or (if provided) the actual date they were created.
The PoliCrowd functionalities briefly described so far will be presented with abundance of details in the following.
Any server (both WMS and ODK) a user connects to is saved into a persistent library which is available to all PoliCrowd users in order to facilitate its reuse. Once users have created customized collections of layers, they can save their projects in a catalogue which is available for the whole community. The users’ credentials, the list of available servers and projects, and the projects themselves (i.e. the available layers and their on/off status, the location and the camera orientation of the point of view over the globe) are stored in the PostgreSQL database on the PoliCrowd server.
PoliCrowd 2.0 introduces the fourth dimension in data visualization. A temporal slider available on the bottom side of the interface (see Fig. 7) allows time filtering of both the ODK marker layers and their multimedia contents. While markers are filtered according to their submission date (i.e. the date they were created from ODK Collect), multimedia contents can be filtered either by the date they were uploaded on the platform or, if available, by the actual date the content was created (i.e. the picture was taken, the video was shot, the audio was recorded). Users can optionally add the date of creation, together with a brief description of the multimedia content, as a metadata during the upload. Time filtering capability makes PoliCrowd particularly suited for historical projects and, more in general, projects where temporal information plays a key role.
Any user (authenticated or anonymous) can access, view and explore all the projects created within the platform and automatically shared with the community. Each project is maintained by its creator (owner). This means that the metadata (project name, project description, etc.), the list of layers used (both WMS and ODK) and the marker styles can be only edited by the project owner. Authenticated users can create and share new projects by adding WMS and ODK layers, uploading new POIs through ODK Collect, and adding comments and multimedia contents to both their own POIs and to preexisting POIs uploaded by other users. The authorization policies ensure that only the owners of the context (projects, POIs, comments, and multimedia contents) can perform editing operations on it.
Telecommunication Data Viewer
Geo-crowdsourced data can be typically visualized and analyzed in two different ways. In the first case, each contribution is treated as a single, self-consistent information and managed as such (e.g. the POIs collected and published in the PoliCrowd application). In the second case, all contributions are pre-processed in order to derive thematic maps describing a widespread phenomenon in a global view. Using this second methodology, starting from data collected by the “citizen sensors” a spatial distributions of the related variables of interest (social, economic, environmental, etc.) is modelled through a geographical grid where each cell value is derived through interpolation functions, sampling and statistical aggregations (Brovelli and Zamboni 2012).
The netCDF Data Format
One of the most widely used storage formats to handle grid-based data in science is netCDF (Network Common Data Form), a machine-independent data format supporting the creation, access and sharing of array-oriented data (Rew et al. 2010). NetCDF is used for storing n-dimensional rectangular structures containing many kinds of scientific data in various fields of observation (climate, ocean, atmospheric, pollution, chemistry, medical imaging, etc.). It is a self-describing, portable, scalable, appendable, shareable and archivable format. In details, a netCDF file includes information about the data it contains (self-describing); it can be accessed by computers with different ways of storing integers, characters and floating-point numbers (portable); a small subset of a large dataset may be accessed efficiently (scalable); data may be appended to a properly structured netCDF file without copying the dataset or redefining its structure (appendable); one writer and multiple readers may simultaneously access the same netCDF file (shareable); access to all earlier forms of netCDF data will be supported by current and future versions of the software (archivable).
NetCDF is not only a machine-independent data format for representing data, but also a set of software interfaces and libraries which support the creation, access and sharing of scientific data. The netCDF software implements an abstract data type, which means that all operations to access and manipulate data in a netCDF dataset must use only the set of functions provided by the interface. The representation of the data is hidden from applications using the interface, so that the way data are stored could be changed without affecting existing programs. The physical representation of netCDF data is designed to be independent of the computer on which the data were written.
EST-WA: A Multidimensional Data Viewer
In the open source domain, a number of applications and libraries are available to visualize and manage netCDF data. Almost all of them rely on a bidimensional approach to visualize and analyse the data, while the third-dimension information (e.g. the height of the data above the ground level) is indirectly represented by means of contour lines, slide sections, graduated colour ramps or numerical values acquired by querying the geometries shown in the 2D visualization. The fourth dimension information (i.e. the time) is instead managed by providing a static “snapshot” of the data at a specific selected point in time. On the opposite EST-WA36 (Environment Space and Time Web Analyzer) is a tool based on netCDF format able to visualize spatio-temporal variable distributions (e.g. sea temperature or soil permeability at different depths, air pollution, temperature, and humidity at different heights) in a multidimensional interface where both space (the 3D scenario) and time are simultaneously shown (Brovelli and Zamboni 2014).
In its general architecture written in Java, EST-WA uses the netCDF Java library, which extends the netCDF core data model and adds functionality implementing Unidata’s Common Data Model (CDM), an abstract data model designed for scientific datasets. The Common Data Model has three layers, which are built on top of each other to add increasingly richer semantics. The “data access layer” (also known as the syntactic layer) handles data reading and writing; the “coordinate system layer” identifies the coordinates of the data arrays; and the “scientific feature type layer” identifies specific types of data such as grids, radial, and point data, and adds specialized methods for each of them. In detail, the “scientific feature type layer” adds functionality for data that is common in earth sciences and in particular provides a GeoGrid and a Grid Coordinate System. The GeoGrid is a specialized variable that explicitly handles X, Y, Z and time (T) dimensions while the Grid Coordinate System (on which the GeoGrid is based) provides a location in real physical space and time for the variables (usually with reference to the Earth). The Grid Coordinate System used by EST-WA at a minimum has a latitude (Lat) and longitude (Lon) coordinate axes, and optionally a time coordinate axis (T) and/or a vertical coordinate axis (Z).
EST-WA2D allows the user to open any netCDF format file and read all of the data and metadata stored within it. Files can be loaded from local storage (e.g. the local file system of the computer where the application runs) or from remote Web servers accessed through the HTTP protocol. The HTTP access is viable thanks to a feature of netCDF files which makes them accessible over the network by exploiting a simple Web server allowing for a range of requests for a resource. In this way the server must not return the data as “chunked” transfer-coding but allows a client to request only the data of interest.
For each variable stored in the netCDF file, the EST-WA2D GUI displays the data type, the measurement unit, the description, the rank, and the axes defining the variable domain. According to the variable type different information is shown. On each axis the measurement unit, the dimension, the step and the minimum/maximum values are reported. For each GeoGrid variable, the grid coordinate system information (i.e. the corresponding axes) is also given. Selecting each single element (variable, domain, grid or axis) it is possible to access the second level of metadata (attribute) and to get the complete overview of the information stored in the netCDF file. After the selection of the variable of interest, it is possible to activate the 2D map pre-viewer (see Fig. 9 left). Besides the usual browsing functionalities (pan, zoom-in and zoom-out), the dynamic map allows to interact with the content of the multidimensional structure by filtering data in both the spatial and the time domain.
For each axis (Lat, Lon, Z, and T) the GUI provides two sliders to select the minimum and maximum values (i.e. the range of the axis) in order to pre-filter the area of interest and select a spatio-temporal sub-domain. When the cursor of each slider is moved, the representation of the data is automatically updated in the viewer providing an immediate visual feedback of the selection. The sub-domain selection is a very useful feature when the spatio-temporal size of the data stored in the netCDF file is wide and the region of interest to be visualized is limited to a specific restricted area. Moreover, this functionality can be used to generate new netCDF files containing sub-sets of the original one, since EST-WA2D allows to export the filtering results.
EST-WA3D is a fully multidimensional netCDF file viewer which uses an innovative “doxel-based” modelling solution specially designed and implemented inside the platform. By extending the existing NASA World Wind Java classes to visualize the geometric primitives, new geometric figures were created. The basic 3D structure of the geometric model used by EST-WA is the voxel, which represents a cell of a regular grid in the three-dimensional space. The voxel is the 3D generalization of the rectangular pixel used in the 2D visualization and it is represented as a parallelepiped. The composition of all the geo-referenced voxels in a regular-grid frame forms the 3D model of the data stored in a netCDF file at a certain time. Each voxel is displayed with graduated colours (based on a colour ramp) depending on the value the variable takes at that position (see Fig. 9 right). When the volume occupied by the whole set of data does not correspond to a full parallelepiped (e.g. the 3D shape of the water filling an irregular natural basin) the voxels are not created in correspondence of the grid cells with “missing value” in order to obtain a full match of data with their representation.
The viewer rendering is optimized by partitioning the 3D model into two logic sub-models: the inner part and the external layer, which is the shell of the model itself. Taking into account the selected cutting planes, the system sends to the rendering engine only the filtered shell doxels (the shell doxels included in the domain delimited by the cutting planes) and the doxels which close the volume at locations corresponding to the cutting planes themselves. Compared to a basic solution where all the doxels are represented, the performance is greatly improved. Just to give an example, considering a cube of 100 × 100 × 100 doxels, in the optimized case only 58,808 values are rendered instead of 1,000,000: the decrease of computation is equal to 94%. A local caching system finally increases the efficiency in accessing and handling the data using a separate management of the whole dataset (static dataset) and the current visible dataset (dynamic dataset) obtained from the insertion/removal of doxels depending on the cutting planes.
Finally, to completely customize the environment and to improve the spatio-temporal contextualization of the variable represented, functionalities for accessing WMS layers are also available. Through a dedicated GUI that can be activated from the menu bar, users can connect to any OGC compliant WMS server and select layers to be displayed on the virtual globe as background and/or auxiliary thematic maps.
Application of EST-WA to Explore Geo-Crowdsourced Data
Geo-crowdsourced data, which are constantly and often unconsciously contributed by users through wearable sensors, are to all effects comparable to the kinds of scientific variables mentioned above whose spatio-temporal analysis is suited for EST-WA exploitation. A specific application is hereafter presented which concerns citizen-sensed telecommunication data.
These data refer to mobile call data records in Milan, Italy, and were made available as open data by the Italian Telecom Italia mobile operator in the frame of the Telecom Italia Big Data Challenge.37 Data have a temporal resolution of 10 min for a total of 2 months (November and December 2013) and a spatial resolution of 235 m × 235 m for a total of 100 × 100 cells covering Milan city. Five different phone activities are recorded: incoming and outcoming calls, incoming and outcoming SMSs (Short Message Services) and Internet connections. In the case of calls and SMSs, a Call Detail Record (CDR) is generated each time a user receives/issues a call or receives/sends an SMS. Regarding the Internet, a CDR is generated each time a user starts or ends a connection or, during the same connection, when there have been more than 15 min or 5 MB from the last generated CDR.
The available data, which include about 100M records, are stored in the NoSQL MongoDB38 database from which, thanks to an ad hoc Python script, netCDF files can be generated on the fly.
These netCDF files are organized as four-dimensional regular grids, where the Z component is represented by the day (at most 61 slices corresponding to the 61 days) and the time component is represented by the 10 min interval (at most 144, corresponding to the count of 10 min timeslots in a day). The dimension of each doxel is therefore 235 m × 235 m × 1 d × 10 min.
The Python script to generate netCDF data is run through a Web application with a form that users have to fill.39 Referring to time there are two main choices. In the first case, users can select either all subsequent days or only Mondays, only Tuesdays, etc. from a starting date to an ending date; in the second case, users can select multiple dates from a calendar. Users have then to select the phone activity they are interested in (calls in, calls out, SMSs in, SMSs out, and Internet connections), submit the request and receive the file. Once the file has been sent to the user, it is deleted from the server filesystem to avoid its overload.
This chapter has investigated the technological-scientific interaction between multidimensional visualization and the universe of VGI and citizen science. Although virtual globes applications and volunteered/contributed GI have both appeared almost a decade ago, their mutual interconnection is still a largely unexplored topic. Virtual globes have had the merit of democratizing GIS (Butler 2006); however 10 years later they remain strongly under-exploited for a number of scientific needs.
As shown in the literature review, VGI-related exploitation of virtual globes is often limited to the pure access and visualization of user-produced datasets (e.g. geotagged photos), with Google Earth—a primarily commercial product—still being the most popular alternative. User interaction is usually restricted to few, simple operations, the amount of accessible data is limited and the use of time dimension to navigate data is almost absent. Thus, validating what Goodchild et al. (2012) stated, still in 2016 we recognize how far the Digital Earth idea envisioned by Gore (1998) is.
In contrast to the current scenario, two advanced applications have been presented which prove the key role multidimensional applications can play when dealing with citizen-sensed data. The first application meets the need of exploiting virtual globes as general-purpose, VGI-based collaboration platforms. Besides retrieving and displaying user-collected data, the platform allows scientific communities to create and manage their own projects. The second application addresses the problem of spatio-temporally exploring complex datasets contributed by citizen sensors. Based on a scientific data format like netCDF, the platform acts as an intelligent geo-viewer able to easily spot macroscopic phenomena and eventually—at a more detailed level—even less evident patterns, which are more complex to study. In contrast to Google Earth, the use of an open source, scientifically oriented virtual globe like NASA World Wind has allowed to deeply customize and enrich the applications according to the needs.
The example of telecommunication data presented above shifts the discussion to the broad theme of big data, which recent literature has shown to be well-connected to VGI (see e.g. Fischer 2012). Despite statistical and processing techniques are required to perform full data analytics (e.g. to correlate telecommunication data to specific weekdays and/or weather/environmental conditions), a thorough visualization represents the first crucial step when dealing with big data.
Finally, it is worth mentioning the difficulties users sometime experience in exploiting complex multidimensional applications such as those described. While a true realization of DE—including robust handling of real-time data streams—would be desirable and beneficial for many scientific and societal needs, digital divide is still preventing a large portion of humankind from access and/or real exploitation. Therefore, there are at least two challenges to face: to reduce the complexity of such applications on one side and to educate people in using them on the other side. On both of them we are strongly working.
- Arsanjani JJ, Zipf A, Mooney P, Helbich M (eds) (2015) OpenStreetMap in GIScience – experiences, research and applications. Springer, BerlinGoogle Scholar
- Blower JD, Gemmell A, Haines K, Kirsch P, Cunningham N, Fleming A, Lowry R (2007) Sharing and visualizing environmental data using Virtual Globes. In Proceedings of the UK e-Science 2007 All Hands Meeting 2007, Nottingham, September 10–13 2007Google Scholar
- Brovelli MA, Zamboni G (2014) Environmental space and time web analyzer. In Proceedings of the 2014 Conference on Big Data from Space (BiDS’14), Research, Technology and Innovation (RT&I) (pp 224–226), Frascati, November 12–14, 2014Google Scholar
- Brovelli MA, Minghini M, Zamboni G (2014) Three dimensional volunteered geographic information: a prototype of a social virtual globe. Int J 3D Inform Model 3(2):19–34Google Scholar
- Brovelli MA, Hogan P, Minghini M, Zamboni G (2013) The power of Virtual Globes for valorising cultural heritage and enabling sustainable tourism: NASA World Wind applications. In: International archives of the photogrammetry, Remote Sensing and Spatial Information Sciences, XL-4/W2, 115–120CrossRefGoogle Scholar
- Cooper AK, Coetzee S, Kourie D (2010) Perceptions of virtual globes, volunteered geographical information and spatial data infrastructures. Geomatica 64(1):73–88Google Scholar
- Craglia M, Goodchild MF, Annoni A, Camara G, Gould M, Kuhn W, Mark D, Masser I, Maguire D, Liang S, Parsons E (2008) Next-generation digital earth: a position paper from the Vespucci Initiative for the Advancement of Geographic Information Science. Int J Spat Data Infrastruct Res 3:146–167Google Scholar
- Craglia M, de Bie K, Jackson D, Pesaresi M, Remetey-Fülöpp G, Wang C, Annoni A, Bian L, Campbell F, Ehlers M, van Genderen J, Goodchild M, Guo H, Lewis A, Simpson R, Skidmore A, Woodgate P (2012) Digital Earth 2020: towards the vision for the next decade. Int J Dig Earth 5(1):4–21CrossRefGoogle Scholar
- Elvidge CD, Tuttle BT (2008) How virtual globes are revolutionizing earth observation data access and integration. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 37-B6a, 137–139Google Scholar
- Fischer F (2012) VGI as Big Data: a new but delicate geographic data-source. GeoInform 15(3):46–47Google Scholar
- Gede M, Ungvári Z, Zentai L (2013) Virtual globes museum 2.0 – adding the power of community. In Proceedings of 26th International Cartographic Conference, Dresden, August 25–30, 2013Google Scholar
- Harvey F (2009) More than names — digital earth and/or virtual globes. Int J Spat Data Infrastruct Res 4:111–116Google Scholar
- Keysers JH (2015) Review of digital globes 2015. http://www.crcsi.com.au/assets/Resources/Globe-review-paper-March-2015.pdf. Accessed 3 Feb 2016
- Kisilevich S, Mansmann F, Bak P, Keim D, Tchaikin A (2010) Where would you go on your next vacation? A framework for visual exploration of attractive places. In Proceedings of the Second International Conference on Advanced Geographic Information Systems, Applications, and Services (GEOprocessing 2010) (pp 21–26), St. Maarten, February 10–16, 2010Google Scholar
- Lindner-Fally M, Zwartjes L (2012) Learning and teaching with digital earth – teacher training and education in Europe. GI Forum 2012:272–282Google Scholar
- Maguire DJ (2007) GeoWeb 2.0 and volunteered GI. In Workshop on Volunteered Geographic Information (pp 104–106), Santa Barbara, CA, December 13–14, 2007Google Scholar
- Nebiker S, Christen M, Eugster H, Flückiger K, Stierli C (2007) Integrating mobile geo sensors into collaborative virtual globes-design and implementation issues. In: Proceedings of the 5th International Symposium on Mobile Mapping Technology MMT’07, Padua, 29–31 May 2007Google Scholar
- O’Reilly T (2005) What is Web 2.0: design patterns and business models for the next generation of software. http://oreilly.com/pub/a/web2/archive/what-is-web-20.html. Accessed 1 Feb 2016
- Peng ZR, Tsou MH (2003) Internet GIS. John Wiley & Sons, Hoboken, NJGoogle Scholar
- Rew R, Davis G, Emmerson S, Davies H, Hartnett E, Heimbigner D (2010) The NetCDF users guide, data model, programming interfaces, and format for self-describing, portable data, NetCDF Version 4.1. Unidata Program CenterGoogle Scholar
- Scharl A, Tochtermann K (eds) (2007) The geospatial web: how geobrowsers, social software and the web 2.0 are shaping the network society. Springer, LondonGoogle Scholar
- See L, Fritz S, Perger C, Schill C, McCallum I, Schepaschenko D, Duerauer M, Sturn T, Karner M, Kraxner F, Obersteiner M (2015) Harnessing the power of volunteers, the internet and Google Earth to collect and validate global spatial information using Geo-Wiki. Technol Forecast Social Change 98:324–335CrossRefGoogle Scholar
- Yovcheva Z, van Elzakker CP, Köbben B (2010). Collaborative mapping and spatio-temporal data dissemination through a web-based virtual globe application. In: Proceedings of 3rd International Conference on Cartography and GIS, Nessebar, 15–20 June 2010Google Scholar
<SimplePara><Emphasis Type="Bold">Open Access</Emphasis> This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.</SimplePara> <SimplePara>The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.</SimplePara>