Position Details

Salary $229K – $262K USD / year

Type Full-Time

Experience senior

Exp. Years 6+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing and implementing large-scale data processing systems, leveraging cloud platforms and big data tools to support analytics and machine learning initiatives.

Key Responsibilities

Designing data pipelines
Leading big data projects
Collaborating with cross-functional teams
Optimizing data storage and retrieval
Mentoring junior engineers

Technical Overview

The technical environment includes Java, Scala, Python, Hadoop, Spark, Kafka, NoSQL databases, cloud services like AWS, Azure, Google Cloud, and data warehousing solutions.

Ideal Candidate

The ideal candidate is a senior data engineer with extensive experience in big data technologies, cloud platforms, and distributed systems. They should have strong programming skills in Java, Python, and Scala, and experience with data warehousing and streaming applications.

Must-Have Skills

Bachelor's Degree6+ years application development2+ years big data technologies1+ year cloud computingexperience with Javaexperience with Pythonexperience with Scalaexperience with AWSAzureor Google Cloud

Nice-to-Have Skills

Master's Degree9+ years application development4+ years cloud experience4+ years NoSQL (MongoCassandra)4+ years data warehousingexperience with streaming applicationsexperience with Gurobiexperience with MySQL

Tools & Platforms

RedshiftSnowflakeHadoopHiveKafkaSparkMongoDBCassandraAWSMicrosoft AzureGoogle Cloud

Required Skills

JavaScalaPythonHadoopSparkKafkaMongoDBCassandraRedshiftSnowflakeAWSAzureGoogle Cloudbig datadistributed microservicesmachine learningcloud computingagile

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed MicroservicesFull Stack SystemsCloud ComputingAWSMicrosoft AzureGoogle CloudHadoopHiveKafkaSparkMongoDBCassandraUNIX/LinuxShell scriptingAgile practices

Soft Skills

collaborationleadershipmentoringproblem-solvingcommunicationteamworkadaptability

Industry & Role

Industry Financial Services

Job Function Developing and maintaining large-scale data infrastructure for analytics and machine learning.

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Microsoft 365, Azure, Google Cloud Platform, Python, Java, SQL / PostgreSQL, Kubernetes, Docker, Active Directory

Keywords for Your Resume

Data EngineerJavaScalaPythonRedshiftSnowflakeHadoopSparkKafkaMongoDBCassandraAWSAzureGoogle Cloudbig datadistributed microservicesfull stack systemsmachine learningcloud computingagiledata engineerjavapythonscalaredshiftsnowflakehadoopsparkkafkamongodb

Deal Breakers

Lack of cloud experience, Less than 6 years of application development, No experience with big data tools, No cloud computing experience, No programming in Java, Python, or Scala

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Lead Data Engineer

Get matched to jobs like this