Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience lead

Exp. Years 4+ years in application development; 2+ years big data; 1+ year cloud

Education Bachelor's Degree

Category Data & Analytics

About this role

Lead data engineering initiatives in Capital One Bank Tech, delivering cloud-native, real-time data solutions across full stack and data warehousing environments.

Key Responsibilities

Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
Lead a team of developers with ML, distributed microservices, and full-stack experience
Use Java/Scala/Python and cloud data warehousing (Redshift/Snowflake)
Mentor engineering community
Deliver cloud-based data solutions for millions

Technical Overview

Stack includes Java, Scala, Python, SQL, NoSQL, Redshift, Snowflake, Hadoop/Hive, EMR, Kafka, Spark, UNIX/Linux, and cloud platforms (AWS/Azure/Google Cloud). Emphasis on data warehousing and streaming data.

Ideal Candidate

The ideal candidate is a lead data engineer with strong data engineering experience, 4+ years in application development, 2+ years in big data tech, and cloud experience across AWS/Azure/Google Cloud. Proficiency in Java/Scala/Python, SQL and NoSQL, plus hands-on with Redshift or Snowflake and streaming tech (Kafka/Spark) is required. They collaborate across Agile teams, mentor engineers, and deliver cloud-based data solutions for financial services.

Must-Have Skills

Bachelor's DegreeAt least 4 years of experience in application developmentAt least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

7+ years of experience in application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)4+ year experience working on real-time data and streaming applications4+ years of experience with NoSQL implementation (MongoCassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with Agile engineering practices

Tools & Platforms

JavaScalaPythonSQLHadoopHiveEMRKafkaSparkMongoDBCassandraMySQLAmazon RedshiftSnowflakeUNIX/LinuxShell scriptingAmazon Web ServicesMicrosoft AzureGoogle Cloud Platform

Required Skills

Bachelor's degreeJavaScalaPythonSQLOpen Source RDBMSNoSQLAmazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkUNIX/LinuxShell scriptingAgile engineering practicesAWSMicrosoft AzureGoogle CloudData warehousing

Hard Skills

JavaScalaPythonSQLOpen Source RDBMSNoSQLAmazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkGurobiMySQLMongoDBCassandraUNIX/LinuxShell scriptingAgile engineering practicesAWSMicrosoft AzureGoogle CloudData warehousing

Soft Skills

Strong communicationLeadershipMentoringTeamworkProblem-solvingStrategic thinkingAdaptabilityStakeholder management

Industry & Role

Industry Banking

Job Function Lead data engineering and cloud-based data warehousing initiatives for Capital One Bank Tech

Role Subtype Lead Data Engineer

Tech Domains Java, Python, SQL / PostgreSQL, Amazon Web Services, Google Cloud Platform, Microsoft Azure, Big Data, Hadoop, Kafka, Spark, Snowflake, Redshift, NoSQL, UNIX/Linux

Keywords for Your Resume

Lead Data EngineerBank TechData EngineerJavaScalaPythonSQLOpen Source RDBMSNoSQLAmazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkGurobiMySQLMongoDBCassandraUNIX/LinuxShell scriptingAgile engineering practicesAWSMicrosoft AzureGoogle CloudData warehousingBig DataCloudRedshift

Deal Breakers

Bachelor's degree not met, 5+ years Python? (not a hard disqualifier here), Unwilling to work in stated locations, No sponsorship availability

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer (Bank Tech)

Get matched to jobs like this