Position Details

Salary $209K – $238K USD / year

Type Not Specified

Experience senior

Exp. Years 6+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing and implementing large-scale data solutions, leveraging big data tools and cloud platforms to support analytics and machine learning initiatives.

Key Responsibilities

Design data pipelines
Support big data systems
Collaborate with data science teams
Optimize data processing
Lead data projects

Technical Overview

The technical environment includes Java, Scala, Python, SQL, Hadoop, Spark, Kafka, Redshift, Snowflake, and cloud services like AWS, Azure, and GCP. The candidate will lead data engineering projects and optimize data pipelines.

Ideal Candidate

The ideal candidate is a senior data engineer with over 6 years of experience in application development, big data technologies, and cloud platforms. They should have strong leadership skills and expertise in distributed data systems.

Must-Have Skills

Bachelor's Degree6+ years of application development experience2+ years in big data technologies1+ year in cloud computing

Nice-to-Have Skills

Master's DegreePythonScalaJavaAWSMicrosoft AzureGoogle CloudDistributed data toolsReal-time dataStreaming applicationsNoSQL (MongoCassandra)Data warehousing (RedshiftSnowflake)Unix/Linux scriptingAgile practices

Tools & Platforms

JavaScalaPythonSQLRedshiftSnowflakeHadoopHiveKafkaSparkGurobiMySQLUnix/Linux

Required Skills

JavaScalaPythonSQLRedshiftSnowflakeHadoopHiveKafkaSparkGurobiMySQLUnix/LinuxAgile

Hard Skills

JavaScalaPythonSQLOpen Source RDBMSNoSQL databasesRedshiftSnowflakeCloud computingDistributed dataHadoopHiveKafkaSparkGurobiMySQLUnix/LinuxAgile

Soft Skills

collaborationmentoringproblem-solvingcommunicationteam leadershiplearning agility

Industry & Role

Industry Financial Services / Banking

Job Function Data engineering and big data system development

Role Subtype Data Engineer

Tech Domains Java, Scala, Python, SQL / PostgreSQL, Amazon Web Services, Google Cloud Platform, Microsoft Azure, Hadoop, Kafka, Spark

Clearance & Visa

Clearance Required None

Visa Sponsorship No

Keywords for Your Resume

JavaScalaPythonSQLRedshiftSnowflakebig datadistributed systemsHadoopHiveKafkaSparkGurobiMySQLUnix/Linuxcloud computingAWSAzureGoogle CloudAgiledata engineering

Deal Breakers

Less than 6 years of experience, No experience with big data tools, Lack of cloud computing experience, No bachelor's degree

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Lead Data Engineer

Get matched to jobs like this