Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience lead

Exp. Years At least 4 years of experience in application development; at least 2 years big data technologies; at least 1 year cloud computing; Preferred: 7+ years application development

Education Bachelor's Degree

Category Data & Analytics

About this role

Lead Data Engineer role within Capital One’s Enterprise Platforms Technology (EPTech), focused on building and supporting cloud-based data solutions. The position works with Agile teams, mentors developers, and delivers scalable solutions using modern data warehousing and big data technologies.

Key Responsibilities

Collaborate across Agile teams to design, develop, test, implement, and support technical solutions
Utilize Java, Scala, Python and RDBMS/NoSQL databases with Redshift and Snowflake
Perform unit tests and code reviews to ensure quality and performance tuning
Collaborate with product managers to deliver robust cloud-based experiences
Share technology learning interests and mentor other members of the engineering community

Technical Overview

The technical stack includes Java, Python, Scala, SQL and working with Open Source RDBMS and NoSQL databases. Data warehousing and cloud services include Redshift and Snowflake, with cloud computing across AWS (Amazon Web Services), Microsoft Azure, and Google Cloud Platform, alongside distributed big data tools such as MapReduce, Hadoop, and Hive.

Ideal Candidate

The ideal candidate is a lead data engineer with 4+ years of application development experience and at least 2 years working with big data technologies. They have at least 1 year of cloud computing experience on AWS (Amazon Web Services), plus strong skills in Java, Python, Scala, SQL, and data warehousing platforms like Redshift and Snowflake.

Must-Have Skills

Bachelor's DegreeAt least 4 years of experience in application development (Internship experience does not apply)At least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

1+ years of experience leveraging AI-assisted coding tools (Claude CodeGitHub Copilot) to accelerate the software delivery7+ years of experience in application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years of experience with Distributed data/computing tools (MapReduceHadoopHive)

Tools & Platforms

JavaPythonScalaSQLAmazon Web ServicesAWSMicrosoft AzureGoogle CloudRedshiftSnowflakeMapReduceHadoopHiveClaude CodeGitHub Copilotunit testscode reviews

Required Skills

Lead Data EngineerEnterprise Platforms Technology (EPTech)JavaPythonScalaSQLOpen Source RDBMSNoSQL databasesRedshiftSnowflakebig data technologiescloud computingAWSMicrosoft AzureGoogle Cloud PlatformAgileunit testscode reviewsperformance tuningMapReduceHadoopHiveClaude CodeGitHub Copilot

Hard Skills

Data EngineeringEnterprise Platforms Technology (EPTech)Agile teamsunit testscode reviewsperformance tuningfull-stack development tools and technologiesJavaPythonScalaOpen Source RDBMSNoSQL databasescloud-based data warehousing servicesRedshiftSnowflakebig data technologiescloud computingAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformDistributed data/computing toolsMapReduceHadoopHive

Soft Skills

collaborationmentoringcross-functional collaborationparticipating in internal & external technology communitiescommunication with digital product managers

Industry & Role

Industry Banking

Job Function Lead enterprise data engineering for EPTech using cloud data warehousing and big data technologies

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Azure, Google Cloud Platform, Python, Java, SQL / PostgreSQL, Kubernetes, Docker

Keywords for Your Resume

Lead Data EngineerEnterprise Platforms TechnologyEPTechData Engineerbig data technologiescloud computingAWSAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformJavaPythonScalaSQLOpen Source RDBMSNoSQL databasesRedshiftAmazon RedshiftSnowflakeAgileunit testscode reviewsperformanceMapReduceHadoopHiveClaude CodeGitHub Copilot

Deal Breakers

Bachelor's Degree required, At least 4 years of experience in application development (internship experience does not apply), At least 2 years of experience in big data technologies, At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer (Enterprise Platforms Technology) ( Java, Python, Scala, AWS)

Get matched to jobs like this