Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience mid

Exp. Years 2+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing and developing data pipelines and analytics solutions using big data technologies and cloud platforms to support enterprise data initiatives.

Key Responsibilities

Design data pipelines
Implement cloud data solutions
Support real-time streaming applications
Collaborate with cross-functional teams
Mentor junior engineers

Technical Overview

The technical environment includes cloud data warehousing (Redshift, Snowflake), distributed computing (Hadoop, Spark), NoSQL databases (MongoDB, Cassandra), and programming in Python, Scala, Java.

Ideal Candidate

The ideal candidate is a mid-level data engineer with 2+ years of experience in big data technologies and cloud platforms like AWS, Azure, or Google Cloud. They possess strong programming skills in Python, Scala, or Java, and have hands-on experience with distributed data systems and streaming applications.

Must-Have Skills

Bachelor's Degreeat least 4 years of application development experienceat least 2 years of big data technologies experienceat least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

7+ years of application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)4+ years working on real-time data and streaming applications4+ years of NoSQL implementation (MongoCassandra)Redshift or Snowflake experienceUNIX/Linux including shell scripting2+ years of Agile practices

Tools & Platforms

RedshiftSnowflakeAWSMicrosoft AzureGoogle CloudHadoopHiveEMRKafkaSparkMongoDBCassandra

Required Skills

JavaScalaPythonOpen Source RDBMSNoSQLRedshiftSnowflakeAWSMicrosoft AzureGoogle CloudHadoopHiveEMRKafkaSparkMongoDBCassandraUNIX/Linuxshell scriptingAgile

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeAWSMicrosoft AzureGoogle Cloudbig data technologiesDistributed data/computing toolsMapReduceHadoopHiveEMRKafkaSparkMongoDBCassandraUNIX/Linuxshell scriptingAgile engineering practices

Soft Skills

collaborationproblem-solvingmentoringlearningtech trend awareness

Industry & Role

Industry Financial Services / Fintech

Job Function Developing and maintaining large-scale data infrastructure and analytics solutions

Keywords for Your Resume

Data Engineerbig dataAWSAmazon Web ServicesAzureGoogle CloudRedshiftSnowflakeHadoopSparkKafkaMongoDBCassandraPythonScalaJavashell scriptingAgile

Deal Breakers

Lack of experience with cloud platforms (AWS, Azure, Google Cloud), Less than 2 years of experience in big data technologies, No experience with distributed data tools like Hadoop or Spark, No programming experience in Python, Scala, or Java

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer

Get matched to jobs like this