Data Warehouse Population Platform

Abstract

The input data for a data warehouse, coming from operational systems, are not immediately ready for loading into data warehouse. It may need cleaning and integration with other data. Moreover, the input data must be transformed and translated into a format more suitable for analytical purposes. This paper presents a generalised platform for population of data warehouses named Data Warehouse Population Platform (DWPP), a set of modules whose aim is to resolve typical aspects arising during the transformation and loading vast amount of data into data warehouse. Using DWPP modules application developers have to add-on only domain specific transformation logic and integrate all in a new Population System. In Telecom Italia Lab we have realised several Population Systems based on DWPP. The Case Study section describes one of them: Population System for Mobile Network Traffic Data Warehouse.