Position Details

Salary $197K – $225K USD / year

Type Not Specified

Experience lead

Exp. Years 4+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

Discover Financial Services is seeking a Lead Data Engineer to develop and optimize data pipelines, leverage big data tools, and support enterprise data initiatives in a collaborative environment.

Key Responsibilities

Design data pipelines
Implement big data solutions
Collaborate with data science teams
Optimize data storage
Support enterprise data initiatives

Technical Overview

Role involves building scalable data pipelines using Python, Scala, Java, and cloud platforms like AWS, Azure, or Google Cloud, with experience in Hadoop, Spark, Kafka, and data warehousing solutions.

Ideal Candidate

The ideal candidate is a senior data engineer with 4+ years experience in big data technologies, proficient in Python, SQL, and cloud platforms, capable of leading data projects and collaborating across teams.

Must-Have Skills

Data EngineeringPythonSQLBig Data Technologies

Nice-to-Have Skills

ScalaJavaCloud ComputingDistributed SystemsMachine LearningData Warehousing

Tools & Platforms

RedshiftSnowflakeHadoopSparkKafkaMongoDBCassandraAWSAzureGoogle Cloud

Required Skills

Data EngineeringPythonScalaJavaSQLNoSQLBig Data TechnologiesData WarehousingCloud ComputingDistributed Systems

Hard Skills

Data EngineeringPythonScalaJavaSQLNoSQLCloud ComputingDistributed SystemsMachine LearningBig Data TechnologiesData Warehousing

Soft Skills

CollaborationProblem-SolvingInnovationCommunicationTeamwork

Certifications

Preferred

AWS Certified Data Analytics - SpecialtyGoogle Cloud Professional Data EngineerMicrosoft Certified: Azure Data Engineer Associate

Industry & Role

Industry Financial Services

Job Function Lead data engineering projects and develop scalable data infrastructure

Role Subtype Data & Analytics

Tech Domains Python, Scala, Java, SQL / PostgreSQL, NoSQL, Amazon Web Services, Google Cloud Platform, Microsoft 365

Keywords for Your Resume

Data EngineerPythonScalaJavaSQLNoSQLBig DataData WarehousingCloud ComputingDistributed SystemsMachine LearningHadoopSparkKafkaRedshiftSnowflakedata engineerpythonsqlbig datahadoopsparkkafkanosqlredshiftsnowflake

Deal Breakers

Less than 4 years of experience, Lack of proficiency in Python or SQL, No experience with big data tools

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer (Enterprise Platforms Technology)

Get matched to jobs like this