Data Platform Migration from Netezza to the Cloud

Migration of data and analytics platforms to the cloud

A leading manufacturer of water quality solutions - water safety, flow control, backflow prevention, drainage operations - globally located in the US, EU and APAC regions with around 1.5B in annual revenues has a strategic vision to migrate their data and analytics platforms to the cloud .There is a need for a scalable centralized analytics data platform on the cloud to consume data for decision-making across the geo-regions and replace the current appliance based platform with cloud capabilities, leveraging the native Azure and modern tools and technologies.

The Business Challenge

• A comprehensive data platform, common across NA, EU and APAC is required to standardize global reporting needs as the current platform operates as individual Data Marts specific to region.

• Standardize/create a common system definition of data attributes. Create a unified data model accessible across all the geo locations platform.

• Build an analytics platform that will scale with data growth from the identified sources, handle data ingestions processes, transform data where required and continue to ingest new data sources to develop new program level KPIs.

The Approach

• Leverage ADF V2 for data ingestion from ERP systems leveraging the native connectors.

• Establish ETL framework on Azure, migrate and validate a complex data pipeline to Informatica.

• Leverage and validate any ETL migration tools available in market to speed up the implantation.

• Migration strategies – One time history data migration and incremental data load.

• Configure centralized DW using Azure SQL DW.

• Benchmark performance report for SQL DW.

• Establish a solution architecture and a roadmap for migrating the Data, ETL and reports from on-prem IBM Suite to Azure.

Transformational Effects

• A two-phased approach with Phase 1 providing the technology and design concepts and layout an architectural roadmap and Phase 2 with implementation of complete data platform migration to Azure public cloud.

• Leverage Azure based services like ADF, ADLS and SQL DW and Informatica IICS by replacing the IBM stack.

• A centralized data platform, which addresses the common reporting needs by adhering to the global security compliances.