Position Details

Salary $179K – $204K USD / year

Type Full-Time

Experience lead

Exp. Years 4+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing and developing data pipelines and analytics solutions using big data technologies and cloud platforms. The engineer will work on scalable, real-time data processing systems to support business insights.

Key Responsibilities

Designing data pipelines
Developing scalable data solutions
Collaborating with cross-functional teams
Implementing real-time streaming applications
Mentoring junior engineers

Technical Overview

The technical environment includes cloud platforms (AWS, Azure, Google Cloud), big data tools (Hadoop, Spark, Kafka), data warehousing (Redshift, Snowflake), and programming in Python, Scala, and Java.

Ideal Candidate

The ideal candidate is a mid-level data engineer with 4+ years of experience in big data technologies and cloud platforms such as AWS, Azure, or Google Cloud. They should have strong programming skills in Python, Scala, and Java, and experience with data warehousing and streaming applications.

Must-Have Skills

Bachelor's Degreeat least 4 years of application development experienceat least 2 years of big data technologies experienceat least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

7+ years of application development including PythonSQLScalaJava4+ years with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with MapReduceHadoopHiveEMRKafkaSparkGurobiMySQL4+ years working on real-time data and streaming applications4+ years with NoSQL (MongoCassandra)4+ years of data warehousing (RedshiftSnowflake)UNIX/Linux basic commands and shell scripting2+ years of Agile practices

Tools & Platforms

RedshiftSnowflakeHadoopHiveKafkaSparkAWSMicrosoft AzureGoogle Cloud

Required Skills

JavaScalaPythonRedshiftSnowflakeHadoopKafkaSparkMachine LearningDistributed MicroservicesAWSMicrosoft AzureGoogle Cloud

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed MicroservicesCloud ComputingAWSMicrosoft AzureGoogle Cloud

Soft Skills

collaborativeproblem-solvingmentoringteamworkcommunicationinnovativetech trend awareness

Industry & Role

Industry Fintech

Job Function Developing and maintaining big data and cloud-based data solutions

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Microsoft 365, Azure, Python, Java, Scala, SQL / PostgreSQL, Hadoop, Kafka, Spark

Clearance & Visa

Clearance Required None

Visa Sponsorship No

Keywords for Your Resume

Data Engineerbig datacloud computingAWSMicrosoft AzureGoogle CloudPythonJavaScalaNoSQLRedshiftSnowflakeHadoopKafkaSparkMachine LearningDistributed Microservicesdata engineer

Deal Breakers

Lack of cloud experience, Less than 4 years of application development, No experience with big data technologies, No proficiency in Python, Scala, or Java

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer

Get matched to jobs like this