Big Data Hadoop Administration
A marketing analytics company that houses and analyzes large amounts of data for Kroger needed a big data platform to scale and deliver insights. This involved large amounts of data, hundreds of jobs running daily, and meeting security and user access requirements.
ILW assisted the infrastructure team on all tasks where a Hadoop Administrator was required, including install, configure, optimize, load balance, disaster recovery, performance tuning, authentication, authorization, data encryption, user support, knowledge transfer, automating metadata backup, and scaling from one cluster to three.
- Built big data clusters to improve speed and productivity to meet demands
- Secured and balanced clusters
- Clusters able to handle multitenancy on a large scale including shared resources between users and services
- 100s of terabytes―a couple of petabytes of data across all clusters
- Oracle BDA (Cloudera), Spark, Impala, Cloudera Manager, Cloudera Key Trustee, KMS, Kerberos, LDAP, Cloudera Navigator (auditing/data lineage)
- Authentication across platforms, HDFS access control lists (ACL), Sentry policies for authorization and encryption of data at rest on clusters
Related Case Studies You May Like
Sensor Data Analysis for Predictive CBM+Customer ChallengeA large grocery chain required a big data and predictive analytics modeling framework to expose information contained in streaming compressor and refrigeration sensor data.Innovative SolutionILW implemented an...
Engines Forecast Reporting ToolCustomer ChallengeUSAF logistics personnel are using a 20+ year old, inflexible, difficult to maintain desktop tool to create forecasts for aircraft engines in their inventory.Innovative SolutionILW is developing a platform to provide...
Agile Big Data Analytics FrameworkCustomer ChallengeA large local retailer needed to consume a substantial amount of data from their customer’s electronic footprint to answer questions that could not be addressed by the current data warehouse.Innovative SolutionILW...
Big Data Engineering for Improved AnalyticsCustomer ChallengeA marketing analytics company that houses and analyzes large amounts of data for Kroger utilizes multiple big data platforms on prem and in the cloud to scale and deliver insights. This involves large...