✦ Luna Orbit — Data & Analytics

Distinguished Engineer - Spark Infrastructure Architecture

at Cisco Systems

Hybrid 💰 $267K – $339K USD / year Posted March 13, 2026
Apply Now → ← Browse All Jobs

Position Details

Salary $267K – $339K USD / year
Type Not Specified
Experience senior
Exp. Years 8+ years
Education Bachelor's in Computer Science (or equivalent) with 15+ years of related experience; or Master's with 12+ years; or PhD with 8+ years or equivalent experience
Category Data & Analytics

About this role

This role involves architecting and operationalizing Spark at scale within Cisco Data Fabric, focusing on building resilient, high-performance data infrastructure for enterprise clients.

Key Responsibilities

  • Architect and operationalize Spark at scale
  • Build resilient infrastructure with fault tolerance
  • Design operational backbone including monitoring and observability
  • Support high availability and performance at petabyte scale
  • Lead technical decisions across engineering teams

Technical Overview

The technical environment includes Apache Spark, cloud platforms like AWS, modern data formats such as Parquet and Iceberg, and Kubernetes for orchestration, emphasizing scalable, fault-tolerant data solutions.

Ideal Candidate

The ideal candidate is a senior data engineer with extensive experience designing and deploying Spark at scale in cloud environments, particularly AWS. They possess strong knowledge of modern data formats and scalable architecture patterns, with a proven track record of leading technical decisions.

Must-Have Skills

Designed and deployed production Spark deployments at scale in cloud environmentsExperience with modern data formats including ParquetIcebergProduction experience with AWS cloud platformLed technical decisions and architectural direction

Nice-to-Have Skills

AzureGCPSnowflakePinotDatabricksTrinoKubernetes in production environmentsMentoring engineers

Tools & Platforms

AWSAmazon Web ServicesKubernetesParquetIceberg

Required Skills

Apache SparkSparkCloud environmentsAWSAmazon Web ServicesParquetIcebergKubernetesK8sData formatsFault toleranceMonitoringObservabilityScalabilityPetabyte scaleArchitectural patterns

Hard Skills

Apache SparkSparkCloud environmentsAWSAmazon Web ServicesParquetIcebergKubernetesK8sData formatsModern data formatsFault toleranceMonitoringObservabilityScalabilityPetabyte scaleArchitectural patterns

Soft Skills

CollaborationRigorous thinkingProblem-solvingTeamworkCommunication

Industry & Role

Industry SaaS / Cloud Data Platforms
Job Function Designing and deploying large-scale Spark data infrastructure in cloud environments

Keywords for Your Resume

Apache SparkSparkCloud environmentsAWSAmazon Web ServicesParquetIcebergKubernetesK8sData formatsFault toleranceMonitoringObservabilityScalabilityPetabyte scaleArchitectural patterns

Deal Breakers

Lack of experience with Spark at scale, No cloud deployment experience, Less than 8 years of relevant experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile