✦ Luna Orbit — Software Engineering

Senior Staff Software Engineer - Lakeflow Pipelines Datasets

at Databricks

📍 Mountain View, California; San Francisco, California Onsite Posted April 03, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Full-Time
Experience lead
Exp. Years 10+ years
Education BS, MS, or PhD in Computer Science or a related field (or equivalent depth of experience).
Category Software Engineering

About this role

Senior Staff Software Engineer to architect and lead the Lakeflow Pipelines data platform. You will set technical direction for declarative pipelines and materialized views, drive cross-team initiatives, and translate research ideas into production-scale data infrastructure.

Key Responsibilities

  • Architect and deliver scalable platform
  • Turn ambiguous challenges into execution plans
  • Bridge research and production
  • Lead deep systems work (diagnostics, debugging, optimization)
  • Drive technical strategy and cross-team coordination

Technical Overview

Ownership of a highly scalable, fault-tolerant data pipeline platform. Focus areas include declarative dataflow processing, materialized views, streaming, and autonomic/self-managing systems, with emphasis on performance and end-to-end reliability.

Ideal Candidate

The ideal candidate is a senior-level software engineer with a decade of experience building and operating large-scale distributed data platforms. They bring deep expertise in dataflow, streaming, storage, and database internals, and can lead long-term technical strategy across multiple teams.

Must-Have Skills

10+ years of experience buildingoperatingand evolving large-scale distributed systems in productionDeep expertise in database internalsDeep expertise in storage systemsDeep expertise in distributed computingDeep expertise in streaming systemsDeep expertise in language/API designDeep expertise in performance engineeringBSMSor PhD in Computer Science or a related field (or equivalent depth of experience)

Required Skills

Declarative Dataflow ProcessingMaterialized ViewsStructured StreamingFlowsLakeflow PipelinesDistributed SystemsDatabase InternalsStorage SystemsStreaming SystemsLanguage/API DesignPerformance EngineeringAutonomic ComputingSelf-Managing SystemsOn-siteFull-time

Hard Skills

Distributed SystemsDatabase InternalsStorage SystemsStreaming SystemsDeclarative Dataflow ProcessingMaterialized ViewsStructured StreamingLanguage/API DesignPerformance EngineeringAutonomic ComputingSelf-Managing Systems

Soft Skills

LeadershipTechnical StrategyCross-functional CollaborationCommunicationProblem SolvingExecution

Industry & Role

Industry SaaS
Job Function Technical architecture and leadership for Lakeflow pipelines platform
Role Subtype Senior Staff Software Engineer

Keywords for Your Resume

Senior Staff Software EngineerLakeflow PipelinesDeclarative Dataflow ProcessingMaterialized ViewsStructured StreamingFlowsLakeflowPipelinesDeclarative Dataflow GraphsAutonomic ComputingSelf-Managing SystemsDistributed SystemsDatabase InternalsStorage SystemsStreaming SystemsLanguage/API DesignPerformance Engineeringexabyte scaleengineering leadertechnical architect

Deal Breakers

Less than 10 years of experience in distributed systems, No depth in database internals or streaming, Inability to work onsite in Mountain View or San Francisco

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile