Position Details

Salary $166K – $230K USD / year

Type Full-Time

Experience senior

Exp. Years Not specified

Education Not specified

Category Data & Analytics

About this role

Build and operate the data platform that helps teams discover, trust, and use data efficiently across Upstart. As a Senior Data Platform Engineer, you will design scalable infrastructure, develop self-serve Lakehouse tooling, and enhance reliability and observability.

Key Responsibilities

Design and build scalable data platform infrastructure
Develop self-serve tooling for Lakehouse data transformations, testing, and deployment workflows
Improve data reliability and observability with monitoring, alerting, and data quality validation
Partner with machine learning engineers, analysts, and product teams to drive adoption
Contribute to platform evolution including metadata services and natural language data access

Technical Overview

This role is focused on Lakehouse data enablement and platform engineering: distributed systems for data discovery and metadata management, tooling for transformations/testing/deployment workflows, and observability via monitoring, alerting, and data quality validation. It also includes platform evolution such as metadata services and natural language data access.

Ideal Candidate

The ideal candidate is a senior data platform engineer experienced in designing and building scalable data platform infrastructure, especially around Lakehouse-based data discovery, metadata management, and data access. They deliver tooling that supports self-serve data transformations, testing, and deployment workflows while improving reliability and observability through monitoring, alerting, and data quality validation. They collaborate closely with machine learning engineers, analysts, and product teams to drive adoption.

Must-Have Skills

Design and build scalable data platform infrastructureDevelop and maintain tooling that enables teams to self-serve data transformationstestingand deployment workflows within the LakehouseImprove data reliability and observability by building systems for monitoringalertingand data quality validation

Required Skills

data platform infrastructuredistributed systemsdata discoverymetadata managementdata accessLakehousedata transformationstestingdeployment workflowsdata reliabilityobservabilitymonitoringalertingdata quality validationmetadata servicesnatural language data accessAI-enabled data interaction

Hard Skills

distributed systemsdata platform infrastructuredata discoverymetadata managementdata accessLakehouse datadata transformationstestingdeployment workflowsdata reliabilityobservabilitymonitoringalertingdata quality validationmetadata servicesnatural language data accessAI-enabled data interaction

Soft Skills

cross-functional collaborationpartnership with machine learning engineerspartnership with analystspartnership with product teamsdriving adoption of platform capabilitiesproblem solvingcommunication

Industry & Role

Industry Fintech

Job Function Engineer a scalable Lakehouse data platform that improves data usability, reliability, and observability.

Role Subtype Data Engineer

Tech Domains SQL / PostgreSQL, Kubernetes, Docker, Amazon Web Services

Keywords for Your Resume

Senior Data Platform Engineerdata platform infrastructuredistributed systemsdata discoverymetadata managementdata accessLakehousedata transformationstestingdeployment workflowsdata reliabilityobservabilitymonitoringalertingdata quality validationmetadata servicesnatural language data accessAI-enabled data interac

Deal Breakers

Must be able to design and build scalable data platform infrastructure, Must have experience improving data reliability and observability (monitoring, alerting, data quality validation)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile