Position Details

Salary $179K – $204K USD / year

Type Full-Time

Experience lead

Exp. Years 4+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves leading data engineering initiatives, developing scalable data pipelines, and working with big data and cloud technologies to support analytics and machine learning projects.

Key Responsibilities

Design data pipelines
Manage big data infrastructure
Implement streaming solutions
Mentor data engineers
Optimize data warehousing

Technical Overview

The position requires expertise in data engineering, distributed systems, cloud data warehousing (Redshift, Snowflake), big data tools (Hadoop, Spark), and real-time streaming applications.

Ideal Candidate

The ideal candidate is a lead data engineer with 4+ years of experience in application development, big data technologies, and cloud platforms like AWS, Azure, or Google Cloud. They are skilled in distributed systems, data warehousing, and real-time data processing.

Must-Have Skills

Bachelor's Degreeat least 4 years of application development experience2+ years of big data technologies1 year experience with cloud computing (AWSAzureGoogle Cloud)

Nice-to-Have Skills

7+ years of application development including PythonSQLScalaor Java4+ years of experience with cloud platforms (AWSAzureGoogle Cloud)4+ years of experience with distributed data tools (MapReduceHadoopHiveEMRKafkaSparkGurobiMySQL)4+ years of experience with real-time data and streaming applications4+ years of NoSQL implementation (MongoCassandra)4+ years of data warehousing (RedshiftSnowflake)4+ years of UNIX/Linux experience2+ years of Agile engineering practices

Tools & Platforms

AWSAmazon Web ServicesRedshiftSnowflakeHadoopHiveEMRKafkaSparkGurobiMySQLUnix/Linux

Required Skills

JavaScalaPythonRedshiftSnowflakeHadoopKafkaSparkGurobiMySQLUnix/Linux

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed microservicesMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLUnix/LinuxShell scripting

Soft Skills

collaborativelearning new technologiesmentoringproblem-solvingteam collaboration

Industry & Role

Industry Fintech

Job Function Lead data engineering projects to build scalable, real-time data solutions using big data and cloud technologies.

Keywords for Your Resume

Lead Data EngineerData EngineeringPythonScalaJavaMachine LearningDistributed microservicesMapReduceHadoopHiveEMRKafkaSparkRedshiftSnowflakeNoSQLMongoCassandraData EngineerAWS

Deal Breakers

Less than 4 years of application development experience, No experience with big data tools or cloud platforms, Lack of experience with distributed data systems

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile