Position Details

Type Contract

Experience senior

Exp. Years 10+ years consulting; 7+ years data engineering

Education Bachelor’s Degree in Computer Science or related field

Category Data & Analytics

About this role

Databricks Solutions Architect embedded as part of the Databricks Partner Program, providing technical leadership for customer engagements and guiding architecture, delivery, and best practices for Databricks implementations.

Key Responsibilities

Embedded technical lead for Databricks engagements
Own Databricks platform architecture and standards
Lead delivery of data pipelines and analytics workloads
Mentor partner/customer delivery teams
Ensure governance, security, and quality standards

Technical Overview

Lead Databricks platform architecture, Spark optimization, and large-scale data platform design across AWS/Azure/GCP; focus on data ingestion, transformation, governance, and security in regulated environments.

Ideal Candidate

The ideal candidate is a senior data engineer with 7+ years in data engineering and 10+ years in client-facing roles, strong Databricks/Spark expertise, and multi-cloud experience across AWS, Azure, or GCP. They should lead architecture and delivery for large-scale data platforms in regulated environments and mentor delivery teams.

Must-Have Skills

Databricks Data Engineering Professional CertificationDatabricks platform architectureApache Spark internals and optimizationAdvanced SQL and PythonScala preferredCloud platform experience (AWSAzureor GCP)Experience delivering large-scale data platformsRegulated or enterprise-scale environments

Nice-to-Have Skills

Solutions Architect experienceMulti-cloud experience (AWSAzureGCP)CI/CD and infrastructure-as-codeMLOps and advanced analytics workloadsUnity Catalogdata governancesecurity architecturesMentoring consulting teams

Tools & Platforms

DatabricksApache SparkPythonSQLScalaAWSAzureGoogle Cloud Platform

Required Skills

DatabricksDatabricks Data Engineering Professional CertificationApache SparkSpark internalsSQLPythonScalaAWSAzureGCPdata pipelinesdistributed data platformsregulated environmentsconsulting

Hard Skills

DatabricksDatabricks Data Engineering Professional CertificationApache SparkSQLPythonScalaTableauAzureAWSGCP

Soft Skills

leadershipmentoringcommunicationdelivery managementstakeholder management

Certifications

Preferred

Databricks Data Engineering Professional Certification

Industry & Role

Industry Government/Public Sector

Job Function Lead architecture and delivery of Databricks-based data platforms for government-focused clients

Role Subtype Senior Data Engineer

Tech Domains Databricks, Apache Spark, Python, SQL, Scala, Cloud platforms, Tableau

Keywords for Your Resume

databricksdata engineersparkapache sparksqlpythonscalaawsazuregcpdatabricks certificationdata pipelinesregulatory environmentsconsultingremoteseniorcontractetlci/cdinfrastructure as code

Deal Breakers

Not a U.S. citizen or unable to obtain DoD Secret clearance, Lacks Databricks Data Engineering Professional Certification, Less than 7 years data engineering experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile