Position Details

Salary $229K – $262K USD / year

Type Full-Time

Experience senior

Exp. Years 6+ years

Education Bachelor's in Computer Science or related field

Category Data & Analytics

About this role

Senior Data Engineering role focused on building and managing large-scale data pipelines and platforms in a cloud environment, supporting enterprise data initiatives.

Key Responsibilities

Design and develop data pipelines
Lead data engineering projects
Collaborate with data scientists and analysts
Implement data governance standards
Optimize data systems for performance

Technical Overview

Environment includes cloud platforms (AWS, Azure, GCP), big data tools (Spark, Hadoop, Kafka), data warehousing (Snowflake, Databricks), and ETL processes.

Ideal Candidate

The ideal candidate is a senior data engineer with extensive experience in big data technologies, cloud platforms, and data pipeline development. They possess strong leadership skills and a solid background in application development and data governance.

Must-Have Skills

Bachelor's Degreeat least 6 years of application development experienceat least 2 years of big data technologiesat least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)4 years of people management experience

Nice-to-Have Skills

Master's Degree9+ years of application development including PythonSQLSparkETL toolsAWS Glue4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)5+ years of distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkMySQL)experience working on real-time data and streaming applications

Tools & Platforms

SnowflakeDatabricksAWSMicrosoft AzureGoogle CloudKafkaHadoopSparkETL tools

Required Skills

PythonSQLSnowflakeDatabricksKafkaHadoopSparkETLdata pipelinesdistributed computing

Hard Skills

PythonSQLOpen Source RDBMSNoSQL databasesSnowflakeDatabricksData pipelinesDistributed computingCloud computingAWSMicrosoft AzureGoogle CloudETL toolsSparkKafkaHadoopHDFS

Soft Skills

collaborationleadershipproblem-solvingmentoringcommunicationteamworkadaptabilitytech trend awareness

Industry & Role

Industry Finance/Banking

Job Function Data engineering and platform development

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Microsoft 365, Azure, Google Cloud Platform, Hadoop, Spark, Kafka, ETL, Data Pipelines, Distributed Computing

Keywords for Your Resume

data engineeringbig datacloud computingAWSMicrosoft AzureGoogle CloudPythonSQLSparkKafkaHadoopETLData pipelinesDistributed computingSnowflakeDatabricksHDFSData qualityData governanceData modelingApplication developmentTeam management

Deal Breakers

Lack of experience with cloud platforms (AWS, Azure, GCP), Less than 4 years of people management experience, No experience with big data tools like Spark or Hadoop, No Bachelor's degree

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Manager, Data Engineering (Enterprise Platforms Technology)

Get matched to jobs like this