Position Details

Salary $209K – $238K USD / year

Type Full-Time

Experience lead

Exp. Years 6+ years

Education Bachelor's in Computer Science or related field

Category Data & Analytics

About this role

This role involves designing and implementing large-scale data solutions, leading data engineering projects, and working with cloud platforms to support business analytics and machine learning initiatives.

Key Responsibilities

Designing data pipelines
Leading data engineering teams
Implementing cloud-based data solutions
Optimizing data warehouse performance
Supporting real-time data streaming

Technical Overview

The technical environment includes big data tools like Hadoop, Spark, Kafka, NoSQL databases such as MongoDB and Cassandra, and cloud services from AWS, Azure, and Google Cloud. The stack emphasizes distributed systems, data warehousing, and real-time data processing.

Ideal Candidate

The ideal candidate is a senior data engineer with 6+ years of experience in application development, big data technologies, and cloud platforms such as AWS, Azure, or Google Cloud. They possess strong leadership skills, expertise in distributed systems, and a passion for innovative data solutions.

Must-Have Skills

Bachelor's Degreeat least 6 years of application development experienceat least 2 years of big data technologies experienceat least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

Master's Degree9+ years of application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)5+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)4+ years working on real-time data and streaming applications4+ years of NoSQL implementation (MongoCassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of UNIX/Linux experience including commands and shell scripting2+ years of Agile engineering practices

Tools & Platforms

RedshiftSnowflakeHadoopHiveKafkaSparkMongoDBCassandraGurobiMySQL

Required Skills

JavaScalaPythonRedshiftSnowflakeHadoopKafkaSparkMongoDBCassandraAWSAzureGoogle Cloudapplication developmentbig datadistributed microservicesmachine learningAgile

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed MicroservicesFull Stack DevelopmentCloud ComputingAWSMicrosoft AzureGoogle Cloud

Soft Skills

collaborationleadershipmentoringproblem-solvingcommunicationteamwork

Industry & Role

Industry Financial Services / Fintech

Job Function Lead data engineering projects to build scalable, cloud-based data solutions.

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Microsoft 365, Azure, Python, Java, SQL / PostgreSQL

Clearance & Visa

Clearance Required None

Visa Sponsorship Yes

Keywords for Your Resume

Data Engineerbig datamachine learningdistributed microservicesfull stack developmentJavaScalaPythonRedshiftSnowflakeAWSMicrosoft AzureGoogle CloudHadoopKafkaSparkMongoDBCassandraMapReduceHDFScloud computingapplication developmentAgile

Deal Breakers

Lack of experience with cloud platforms (AWS, Azure, Google Cloud), Less than 2 years of big data experience, No experience with distributed microservices, No application development background

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Lead Data Engineer

Get matched to jobs like this