Position Details

Salary $179K – $204K USD / year

Type Full-Time

Experience lead

Exp. Years 4+ years

Education Bachelor's in Computer Science or related field

Category Data & Analytics

About this role

This role involves leading data engineering initiatives, focusing on building and optimizing data pipelines using big data tools, cloud platforms, and data warehousing solutions.

Key Responsibilities

Design and develop data pipelines
Optimize data models
Collaborate with data teams
Support real-time data streaming
Mentor junior data engineers

Technical Overview

The technical environment includes Python, SQL, Spark, Snowflake, Databricks, and AWS, with a focus on big data processing, data modeling, and cloud data warehousing.

Ideal Candidate

The ideal candidate is a senior data engineer with 4+ years of experience in big data technologies, cloud data warehousing, and data modeling. They are proficient in Python, SQL, Spark, and AWS, with a passion for building scalable data pipelines.

Must-Have Skills

Bachelor's Degreeat least 4 years of experience in application developmentexperience with big data technologiesexperience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

Master's Degreeexperience leveraging AI-assisted coding tools (Claude CodeGitHub Copilot)7+ years of experience in application development including PythonSQLSparkETL toolsAWS Glue4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkMySQL)4+ years of experience working on real-time data and streaming applications

Tools & Platforms

SnowflakeDatabricksAWSAmazon Web ServicesSparkETL toolsbig data technologies

Required Skills

PythonSQLSparkSnowflakeDatabricksAWSbig data technologiesdata modelingdata pipelinescloud data warehousing

Hard Skills

PythonSQLSparkSnowflakeDatabricksAWSAmazon Web Servicesbig data technologiesdata modelingdata pipelinescloud data warehousing

Soft Skills

collaborationteamworkproblem-solvingmentoringlearningcommunication

Industry & Role

Industry Fintech

Job Function Lead data engineering projects with a focus on big data and cloud solutions

Role Subtype Data Engineer

Tech Domains Python, SQL / PostgreSQL, Amazon Web Services, Spark, Snowflake, Databricks

Clearance & Visa

Clearance Required None

Visa Sponsorship No

Keywords for Your Resume

data engineerbig datapythonsqlsparksnowflakedatabricksawsamazon web servicescloud data warehousingETLdata pipelinesdata modelinghadoopmapreducekafkastreaming applicationscloud computing

Deal Breakers

Less than 4 years of experience in application development, No experience with big data technologies, Lack of cloud computing experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, GenAI)

Get matched to jobs like this