Position Details

Salary $161K – $184K USD / year

Type Full-Time

Experience mid

Exp. Years 3+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

A mid-level data engineer role focused on building and maintaining large-scale data pipelines and analytics infrastructure within a financial services environment.

Key Responsibilities

Design and develop data pipelines
Optimize data processing performance
Support real-time streaming applications
Collaborate with data science teams
Maintain data warehouse solutions

Technical Overview

Environment involves big data processing with Hadoop, Spark, Kafka, data warehousing with Redshift and Snowflake, and scripting in Unix/Linux systems, supporting real-time and batch data workflows.

Ideal Candidate

The ideal candidate is a mid-level data engineer with at least 3 years of experience in application development and big data technologies, proficient in Python, Scala, Java, and experienced with distributed data tools like Hadoop and Spark. They should have familiarity with data warehousing solutions such as Redshift or Snowflake and be comfortable working in cloud environments.

Must-Have Skills

Bachelor's Degree3+ years application development1+ year in big data technologiesExperience with PythonSQLScalaJavaExperience with distributed data toolsExperience with NoSQL and data warehousing

Nice-to-Have Skills

5+ years application development2+ years cloud experience (AWSAzureGCP)3+ years distributed data tools2+ years real-time data/streaming2+ years NoSQL (MongoCassandra)2+ years data warehousing (RedshiftSnowflake)3+ years UNIX/Linux2+ years Agile practices

Tools & Platforms

JavaScalaPythonRedshiftSnowflakeHadoopHiveKafkaSparkGurobiMySQLUnix/LinuxShell scripting

Required Skills

JavaScalaPythonHadoopSparkKafkaHiveRedshiftSnowflakeNoSQLUnix/LinuxShell scripting

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMapReduceHadoopHiveKafkaSparkGurobiMySQLUnix/LinuxShell scripting

Soft Skills

CollaborationProblem-solvingPerformance tuningTeamworkMentoring

Industry & Role

Industry Financial Services / Banking

Job Function Building and supporting data infrastructure for analytics and reporting

Keywords for Your Resume

Senior Data EngineerData EngineerBig DataPythonScalaJavaHadoopSparkKafkaHiveRedshiftSnowflakeNoSQLData warehousingUnix/LinuxShell scripting

Deal Breakers

Less than 3 years of experience, No experience with big data tools, Lack of proficiency in Python, Scala, Java, No experience with data warehousing or NoSQL

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile