Position Details

Type Contract

Experience senior

Exp. Years 5+ years

Education Not specified

Category Data & Analytics

About this role

Senior Data Engineer (Tech Lead) to design and optimize scalable data pipelines in Databricks/Azure, focusing on Delta Lake governance and reporting.

Key Responsibilities

Lead design/development of scalable data pipelines
Move and transform data into Azure Data Lake
Ensure data quality with tests
Collaborate with cross-functional teams in Agile
Mentor engineers

Technical Overview

Lead data engineering in Azure ecosystem, with Databricks, Unity Catalog, Delta Tables, and Apache Spark; ensure data quality, testing, and collaboration with analytics teams. Nearshore EST hours and remote work.

Ideal Candidate

The ideal candidate is a senior data engineer/tech lead with 5+ years in Databricks and Azure data services, building scalable data pipelines, and leading data engineering initiatives.

Must-Have Skills

5+ years of Databricks experience (Certification required)5+ years of Azure Data Factory experience5+ years of strong SQL development experienceTech Lead or senior-level engineering roleAgile methodologies

Nice-to-Have Skills

Power BI developmentApache Spark programmingdata validationtesting frameworkspipeline monitoring

Tools & Platforms

DatabricksAzure Data FactoryAzure Data LakeUnity CatalogDelta TablesDelta LakeApache SparkPower BI

Required Skills

DatabricksAzure Data FactoryAzure Data LakeUnity CatalogDelta TablesDelta LakeApache SparkSQLPower BI

Hard Skills

DatabricksAzure Data FactorySQLAzureAzure Data LakeUnity CatalogDelta TablesDelta LakeApache SparkPower BIPython?Scripting

Soft Skills

leadershipmentorshipcommunicationcollaborationmentoring

Certifications

Required

Databricks Certification

Industry & Role

Industry Information Technology

Job Function Lead data engineering efforts on Databricks/Azure to power reporting and analytics

Role Subtype Tech Lead

Tech Domains Azure, Apache Spark, SQL / PostgreSQL, Power BI, Azure Data Factory, Azure Data Lake, Unity Catalog, Delta Tables, Delta Lake, Databricks

Keywords for Your Resume

senior data engineerdatabricksazure data factoryazure data lakeunity catalogdelta tablesdelta lakeapache sparksqlpower biazurecertification requiredtech leadcontractremoteest business hoursagiledata pipelinesetldata validations3glue

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Data Engineer (Tech Lead) – Databricks / Azure

Get matched to jobs like this