Position Details

Salary $229K – $262K USD / year

Type Full-Time

Experience lead

Exp. Years 6+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves leading data engineering initiatives focused on building scalable data pipelines, ensuring data quality, and managing large data warehouses in a cloud environment.

Key Responsibilities

Design and develop data pipelines
Ensure data quality and governance
Lead data warehouse projects
Implement real-time data streaming
Mentor data engineering teams

Technical Overview

The technical environment includes Python, SQL, Spark, ETL tools, AWS Glue, NoSQL databases like MongoDB and Cassandra, Snowflake, and Databricks for distributed data processing.

Ideal Candidate

The ideal candidate is a senior data engineer with extensive experience in building data pipelines, data modeling, and working with big data technologies in cloud environments, with leadership skills to mentor teams.

Must-Have Skills

Bachelor's Degree6+ years application developmentExperience with big data technologiesExperience with cloud computingData pipeline developmentData modelingData quality and governance

Nice-to-Have Skills

Master's DegreeExperience with PythonSQLSparkETL toolsAWS GlueExperience with NoSQL databasesReal-time data streamingData analytics tools

Tools & Platforms

PythonSQLSparkETL toolsAWS GlueMongoDBCassandraSnowflakeDatabricks

Required Skills

PythonSQLSparkETL toolsAWS GlueNoSQLMongoDBCassandraData modelingData qualityData governanceData pipelinesData warehousingSnowflakeDatabricksBig DataDistributed computing

Hard Skills

PythonSQLSparkETL toolsAWS GlueNoSQLMongoDBCassandraData modelingData qualityData governanceData pipelinesData warehousingSnowflakeDatabricksBig DataDistributed computing

Soft Skills

CollaborationMentoringProblem-solvingTeam leadershipCommunication

Industry & Role

Industry Financial Services, Banking

Job Function Leading data pipeline development and data management in a cloud-based environment

Role Subtype Data Engineer

Tech Domains Python, SQL, Spark, ETL tools, AWS Glue, MongoDB, Cassandra, Snowflake, Databricks

Keywords for Your Resume

data engineerbig datadata pipelinesETLAWS GluePythonSQLSparkNoSQLMongoDBCassandraData modelingData qualityData governanceData warehousingSnowflakeDatabricksdistributed computingreal-time databig data technologies

Deal Breakers

Less than 6 years experience, No experience with big data tools, Lack of cloud data platform experience, No experience with data governance, No experience with data pipelines

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Lead Data Engineer (Enterprise Platforms Technology)

Get matched to jobs like this