Position Details

Type Full-Time

Experience senior

Exp. Years 8+ years

Education Bachelor's in Computer Science or related field

Category Software Engineering

About this role

Databricks is seeking a Senior Engineering Manager to lead the Photon team, focusing on building a cutting-edge query engine and data processing platform. The role involves managing engineering talent, driving technical innovation, and collaborating on product roadmaps.

Key Responsibilities

Lead and grow engineering team
Drive development of Photon query engine
Define product roadmap with leadership
Foster technical excellence and innovation
Mentor future leaders

Technical Overview

The role involves working on database kernel internals, query execution and optimization, storage engines, and large-scale distributed systems within a SaaS data platform environment, leveraging technologies like Apache Spark and Delta Lake.

Ideal Candidate

The ideal candidate is a senior-level engineering manager with extensive experience in database internals, query engines, and distributed systems. They possess strong leadership skills, a track record of managing high-performance teams, and deep technical expertise in scalable data processing platforms.

Must-Have Skills

Deep expertise in database kernel or internals development8+ years of experience in database internals or related systems engineering5+ years of engineering management experienceProven ability to hiredevelopand retain top engineering talentStrong track record of delivering complexhigh-scale distributed systems

Nice-to-Have Skills

Experience with Apache SparkExperience with Delta LakeExperience with MLflowExperience leading data infrastructure teamsExperience with query engines

Tools & Platforms

Apache SparkDelta LakeMLflowData & AI infrastructure platforms

Required Skills

Database internalsQuery executionQuery optimizationStorage enginesDistributed systemsSoftware engineeringLeadershipTeam managementMentorshipScalabilityPerformance tuning

Hard Skills

Database internalsQuery executionQuery optimizationStorage enginesDistributed systemsSoftware engineeringC++JavaPythonScalabilityPerformance tuning

Soft Skills

LeadershipTeam managementTechnical mentorshipCollaborationProblem-solvingInnovationCommunication

Industry & Role

Industry SaaS

Job Function Lead engineering teams to develop high-performance data processing systems

Keywords for Your Resume

Senior Engineering ManagerDatabase internalsQuery executionQuery optimizationStorage enginesDistributed systemsSoftware engineeringLeadershipTeam managementMentorshipScalabilityPerformance tuningApache SparkDelta LakeMLflowData & AI infrastructureCloud data platform

Deal Breakers

Lack of experience in database internals or distributed systems, No management experience in engineering teams, Unable to work in San Francisco or remote without location flexibility, Lack of leadership or mentorship skills

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Sr. Engineering Manager - Photon Team (San Francisco)

Get matched to jobs like this