Big Data Engineering for Improved Analytics

Customer Challenge

A marketing analytics company that houses and analyzes large amounts of data for Kroger utilizes multiple big data platforms on prem and in the cloud to scale and deliver insights. This involves large amounts of data and hundreds of jobs running daily.

Innovative Solution

ILW is retooling legacy data pipelines into modern data platforms like Google Cloud Platform (GCP), Azure Platform, and on-prem Hadoop to shrink the deliver time of long-loop analytics. Legacy systems took up to a month to run long quires to drive deep learning results on massive datasets. Modern platforms can produce results in minutes when correctly reengineered. 

Benefits/Outcomes

  • Near real-time deep learning and machine learning
  • Code written to run on any big data architecture
    for future growth
  • Discover and apply learned results to adjust market strategies

Toolbox

  • 1,000s of terabytes of data―a couple petabytes across multiple clusters
  • Google Cloud, Azure, Hadoop, Spark, Python, PySpark, Airflow, Oracle
  • Data science, machine learning, deep learning, cloud services, big data
  • Agile methodology, big data best practices

Related Case Studies you may like

Sensor Data Analysis for Predictive CBM+

Sensor Data Analysis for Predictive CBM+

Sensor Data Analysis for Predictive CBM+Customer ChallengeA large grocery chain required a big data and predictive analytics modeling framework to expose information contained in streaming compressor and refrigeration sensor data.Innovative SolutionILW implemented an...

Engines Forecast Reporting Tool

Engines Forecast Reporting Tool

Engines Forecast Reporting ToolCustomer ChallengeUSAF logistics personnel are using a 20+ year old, inflexible, difficult to maintain desktop tool to create forecasts for aircraft engines in their inventory.Innovative SolutionILW is developing a platform to provide...

Big Data Hadoop

Big Data Hadoop

Big Data Hadoop AdministrationCustomer ChallengeA marketing analytics company that houses and analyzes large amounts of data for Kroger needed a big data platform to scale and deliver insights. This involved large amounts of data, hundreds of jobs running daily, and...

Agile Big Data Analytics Framework

Agile Big Data Analytics Framework

Agile Big Data Analytics FrameworkCustomer ChallengeA large local retailer needed to consume a substantial amount of data from their customer’s electronic footprint to answer questions that could not be addressed by the current data warehouse.Innovative SolutionILW...

Interested In Working With Us?