Practical Hadoop Migration

How to Integrate Your RDBMS with the Hadoop Ecosystem and Re-Architect Relational Applications to NoSQL

  • Bhushan Lakhe

Table of contents

  1. Front Matter
    Pages i-xxiv
  2. Relational Database Management Systems: A Review of Design Principles, Models and Best Practices

    1. Front Matter
      Pages 25-25
    2. Bhushan Lakhe
      Pages 27-52
    3. Bhushan Lakhe
      Pages 53-88
    4. Bhushan Lakhe
      Pages 89-99
  3. Hadoop: A Review of the Hadoop Ecosystem, NoSQL Design Principles and Best Practices

    1. Front Matter
      Pages 101-101
    2. Bhushan Lakhe
      Pages 103-116
  4. Integrating Relational Database Management Systems with the Hadoop Distributed File System

    1. Front Matter
      Pages 149-149
    2. Bhushan Lakhe
      Pages 151-188
  5. Transitioning from Relational to NoSQL Design Models

    1. Front Matter
      Pages 207-207
    2. Bhushan Lakhe
      Pages 253-276
  6. Case Study for Designing and Implementing a Hadoop-based Solution

    1. Front Matter
      Pages 277-277
    2. Bhushan Lakhe
      Pages 279-302
  7. Back Matter
    Pages 303-305

About this book


Re-architect relational applications to NoSQL, integrate relational database management systems with the Hadoop ecosystem, and transform and migrate relational data to and from Hadoop components. This book covers the best-practice design approaches to re-architecting your relational applications and transforming your relational data to optimize concurrency, security, denormalization, and performance.

Winner of IBM’s 2012 Gerstner Award for his implementation of big data and data warehouse initiatives and author of Practical Hadoop Security, author Bhushan Lakhe walks you through the entire transition process. First, he lays out the criteria for deciding what blend of re-architecting, migration, and integration between RDBMS and HDFS best meets your transition objectives. Then he demonstrates how to design your transition model.

Lakhe proceeds to cover the selection criteria for ETL tools, the implementation steps for migration with SQOOP- and Flume-based data transfers, and transition optimization techniques for tuning partitions, scheduling aggregations, and redesigning ETL. Finally, he assesses the pros and cons of data lakes and Lambda architecture as integrative solutions and illustrates their implementation with real-world case studies.

Hadoop/NoSQL solutions do not offer by default certain relational technology features such as role-based access control, locking for concurrent updates, and various tools for measuring and enhancing performance. Practical Hadoop Migration shows how to use open-source tools to emulate such relational functionalities in Hadoop ecosystem components.

What You'll Learn

  • Decide whether you should migrate your relational applications to big data technologies or integrate them
  • Transition your relational applications to Hadoop/NoSQL platforms in terms of logical design and physical implementation
  • Discover RDBMS-to-HDFS integration, data transformation, and optimization techniques
  • Consider when to use Lambda architecture and data lake solutions 
  • Select and implement Hadoop-based components and applications to speed transition, optimize integrated performance, and emulate relational functionalities
Who This Book Is For

Database developers, database administrators, enterprise architects, Hadoop/NoSQL developers, and IT leaders. Its secondary readership is project and program managers and advanced students of database and management information systems.


RDBMS SSADM NoSQL Hadoop Lambda architecture enterprise data warehouse data lake concurrency denormalization HDFS SQOOP Flume ETL

Authors and affiliations

  • Bhushan Lakhe
    • 1
  1. 1.DarienUSA

Bibliographic information