Advertisement

Practical DataOps

Delivering Agile Data Science at Scale

  • Harvinder Atwal

Table of contents

  1. Front Matter
    Pages i-xxviii
  2. Getting Started

    1. Front Matter
      Pages 1-1
    2. Harvinder Atwal
      Pages 3-26
    3. Harvinder Atwal
      Pages 27-53
  3. Toward DataOps

    1. Front Matter
      Pages 55-55
    2. Harvinder Atwal
      Pages 57-83
    3. Harvinder Atwal
      Pages 85-112
    4. Harvinder Atwal
      Pages 113-137
  4. Further Steps

    1. Front Matter
      Pages 139-139
    2. Harvinder Atwal
      Pages 141-159
    3. Harvinder Atwal
      Pages 161-189
    4. Harvinder Atwal
      Pages 191-211
  5. The Self-Service Organization

    1. Front Matter
      Pages 213-213
    2. Harvinder Atwal
      Pages 215-247
    3. Harvinder Atwal
      Pages 249-266
  6. Back Matter
    Pages 267-275

About this book

Introduction

Gain a practical introduction to DataOps, a new discipline for delivering data science at scale inspired by practices at companies such as Facebook, Uber, LinkedIn, Twitter, and eBay. Organizations need more than the latest AI algorithms, hottest tools, and best people to turn data into insight-driven action and useful analytical data products. Processes and thinking employed to manage and use data in the 20th century are a bottleneck for working effectively with the variety of data and advanced analytical use cases that organizations have today. This book provides the approach and methods to ensure continuous rapid use of data to create analytical data products and steer decision making.

Practical DataOps shows you how to optimize the data supply chain from diverse raw data sources to the final data product, whether the goal is a machine learning model or other data-orientated output. The book provides an approach to eliminate wasted effort and improve collaboration between data producers, data consumers, and the rest of the organization through the adoption of lean thinking and agile software development principles.

This book helps you to improve the speed and accuracy of analytical application development through data management and DevOps practices that securely expand data access, and rapidly increase the number of reproducible data products through automation, testing, and integration. The book also shows how to collect feedback and monitor performance to manage and continuously improve your processes and output. 

You will:
  • Develop a data strategy for your organization to help it reach its long-term goals
  • Recognize and eliminate barriers to delivering data to users at scale
  • Work on the right things for the right stakeholders through agile collaboration
  • Create trust in data via rigorous testing and effective data management
  • Build a culture of learning and continuous improvement through monitoring deployments and measuring outcomes
  • Create cross-functional self-organizing teams focused on goals not reporting lines
  • Build robust, trustworthy, data pipelines in support of AI, machine learning, and other analytical data products

Keywords

DataOps Data Science Data Engineering Machine Learning Artificial Intelligence Advanced Analytics Cloud Analytics Agile Data Science Lean Analytics MLOps Big Data

Authors and affiliations

  • Harvinder Atwal
    • 1
  1. 1.IsleworthUK

Bibliographic information