✦ Luna Orbit — Software Engineering

Senior Software Engineer - Database Engine Internals

at Databricks

📍 San Francisco, California Unknown Posted March 10, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Not Specified
Experience senior
Exp. Years 5+ years
Education Not specified
Category Software Engineering

About this role

This role focuses on developing high-performance distributed data storage and processing systems to support large-scale data analytics at Databricks.

Key Responsibilities

  • Developing distributed data storage systems
  • Building data pipelines
  • Implementing ACID transactions
  • Optimizing data processing performance
  • Supporting cloud storage integrations

Technical Overview

The technical environment includes Java, Scala, C++, Apache Spark, Hadoop, cloud storage, and data pipeline technologies, emphasizing scalable and reliable data systems.

Ideal Candidate

The ideal candidate is a senior software engineer with over 5 years of experience in distributed data systems, proficient in Java, Scala, or C++, and experienced with big data frameworks like Spark and Hadoop. They are passionate about building scalable data storage and processing solutions.

Must-Have Skills

5+ years of experience in JavaScalaor C++Experience with distributed systemsKnowledge of big data systemsExperience with data pipelinesUnderstanding of ACID transactions

Nice-to-Have Skills

Experience with Delta LakeKnowledge of cloud storage backends

Tools & Platforms

Apache SparkHadoopAWS S3Azure Blob Storage

Required Skills

JavaScalaC++Distributed systemsBig data systemsApache SparkHadoopData storageData pipelinesACID transactionsTime travel

Hard Skills

JavaScalaC++Distributed systemsBig data systemsApache SparkHadoopData storageData pipelinesACID transactionsTime travel

Soft Skills

Passion for data systemsCustomer impact focusProblem-solvingTeam collaborationInnovative thinking

Industry & Role

Industry SaaS
Job Function Building scalable distributed data storage and processing systems for big data analytics

Keywords for Your Resume

Senior Software EngineerDistributed systemsBig data systemsApache SparkHadoopData pipelinesACID transactionsTime travelJavaScalaC++Data storageData processingCloud storage

Deal Breakers

Less than 5 years of experience, Lack of experience with distributed systems, No background in big data frameworks

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile