Position Details

Salary $179K – $204K USD / year

Type Not Specified

Experience lead

Exp. Years 4+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

Lead Data Engineer responsible for building and maintaining Capital One's data engineering solutions, leveraging big data technologies and cloud platforms to support analytics and financial empowerment.

Key Responsibilities

Collaborate with Agile teams
Design and develop full-stack solutions
Work with machine learning and distributed systems
Ensure performance and scalability
Mentor engineers

Technical Overview

Stack includes Java, Scala, Python, SQL; big data tools like Hadoop/Hive, Spark, Kafka; cloud platforms AWS/Azure/Google Cloud; data warehousing with Redshift/Snowflake; NoSQL like MongoDB/Cassandra; UNIX/Linux environment; Agile practices.

Ideal Candidate

The ideal candidate is a senior data engineer with 4+ years in application development and strong experience with big data technologies and cloud platforms, capable of delivering scalable data solutions in a financial services setting.

Must-Have Skills

Bachelor's Degree4+ years of application development experience2+ years of big data technologies1+ year of cloud computing experience (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

7+ years of application development including PythonSQL or Scala4+ years with a public cloud (AWSAzureGCP)4+ years with distributed data/tools (MapReduceHadoopHiveEMRKafkaSparkGurobiMySQL)4+ years real-time data and streaming4+ years NoSQL (MongoCassandra)4+ years data warehousing (Redshift or Snowflake)4+ years UNIX/Linux2+ years Agile

Tools & Platforms

JavaScalaPythonSQLMongoDBCassandraHadoopHiveSparkKafkaRedshiftSnowflakeEMRAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformUnixLinux

Required Skills

Bachelor's Degree4+ years application development2+ years big data technologies1+ year cloud computing (AWS/Azure/GCP)JavaScalaPythonSQLHadoopHiveSparkKafkaElasticsearchMongoDBCassandraRedshiftSnowflakeUnix/LinuxAgile

Hard Skills

JavaScalaPythonSQLMongoDBCassandraRedshiftSnowflakeHadoopHiveEMRKafkaSparkMapReduceGurobiMySQLUnix/LinuxAgileAmazon Web ServicesMicrosoft AzureGoogle Cloud Platform

Soft Skills

communicationteamworkproblem-solvingmentoringattention to detailadaptabilitytime managementcollaboration

Industry & Role

Industry Banking

Job Function Design and deliver data engineering solutions to enable Capital One's analytics and ML initiatives

Role Subtype Lead Data Engineer

Tech Domains Amazon Web Services, Microsoft Azure, Google Cloud Platform, Python, Java, SQL / PostgreSQL, Hadoop, Hive, Kafka, Spark, Redshift, Snowflake, MongoDB, Cassandra, Unix/Linux

Clearance & Visa

Visa Sponsorship No

Keywords for Your Resume

lead data engineercapital oneplanodata engineeringbig dataawsamazon web servicesmicrosoft azuregoogle cloud platformpythonsqlscalahadoophiveemrkafkasparkredshiftsnowflakemongodbcassandraunixlinuxagilereal-time datadata warehousing4 years

Deal Breakers

Must be authorized to work in the United States (visa sponsorship not available)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile