Position Details

Salary $136K – $204K USD / year

Type Not Specified

Experience senior

Exp. Years Not specified

Education Not specified

Category Cloud & Infrastructure

About this role

This role involves leading the engineering and operation of cloud-based big data platforms, primarily on AWS, ensuring scalability, security, and reliability across enterprise data systems.

Key Responsibilities

Administer and engineer Big Data platforms across Hadoop clusters
Design and maintain scalable multi-tenant Data Platforms
Drive operational excellence and incident management
Apply SRE principles for automation and reliability
Collaborate with data engineers and security teams

Technical Overview

The technical environment includes AWS EMR, Hadoop clusters, Infrastructure as Code tools like Terraform, and observability tools. The focus is on cloud data platform engineering, automation, and site reliability.

Ideal Candidate

The ideal candidate is a senior cloud engineer with extensive experience in AWS, EMR, Hadoop, and infrastructure automation. They should have a strong background in data platform engineering, security, and site reliability engineering, with leadership skills to mentor teams.

Must-Have Skills

AWS Big Data/EMR infrastructureInfrastructure as CodeHadoop clustersCloud platformsSecurityAutomationObservabilityIncident triagingService restorationData platform engineering

Nice-to-Have Skills

Containerized environmentsServerless environmentsMulti-tenant Data PlatformsProactive alertingProactive response mechanismsData technologiesAnalyticsData visualization

Tools & Platforms

AWS EMRHadoopTerraformCloudFormationSplunkKubernetesDocker

Required Skills

AWSEMRHadoopInfrastructure as CodeIaCSecurityAutomationObservabilitySREData PlatformsData EngineeringData Analytics

Hard Skills

AWSAmazon Web ServicesEMRElastic MapReduceInfrastructure as CodeIaCHadoopCloud Big DataSecurityAutomationObservabilitySite Reliability EngineeringSREData PlatformsData EngineeringData Analytics

Soft Skills

LeadershipCollaborationTechnical excellenceInnovationProblem-solvingMentoringTeamworkCommunication

Industry & Role

Industry Insurance

Job Function Lead cloud-based big data platform engineering and operations

Role Subtype Cloud Engineer

Tech Domains Amazon Web Services, Active Directory, Linux, Kubernetes, Docker

Keywords for Your Resume

AWSAmazon Web ServicesEMRElastic MapReduceHadoopInfrastructure as CodeIaCCloud Big DataSecurityAutomationObservabilitySite Reliability EngineeringSREData PlatformsData EngineeringData AnalyticsData platformsData engineering

Deal Breakers

Lack of experience with AWS EMR or Hadoop, No background in infrastructure as code, No experience in data platform engineering, Lack of leadership or mentoring skills

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Platform Engineer - Big Data

Get matched to jobs like this