Position Details

Salary $179K – $204K USD / year

Type Full-Time

Experience lead

Exp. Years 4+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

Lead Data Engineer at Capital One tasked with designing, developing, testing, and deploying data-driven solutions in a cloud data warehouse environment, collaborating with agile teams and mentoring engineers.

Key Responsibilities

Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
Work with developers in ML, distributed microservices, and full stack systems
Utilize Java, Scala, Python and data stores and cloud data warehouses
Perform unit tests and code reviews
Mentor other engineers and stay on top of tech trends

Technical Overview

Stack includes Java/Scala/Python, SQL/NoSQL databases, Hadoop/Spark ecosystem, and cloud data warehouses (Amazon Redshift, Snowflake) across AWS/Azure/Google Cloud; emphasizes big data, real-time data, and agile practices.

Ideal Candidate

The ideal candidate is an experienced data engineer with 4+ years in big data analytics, proficient in Java/Python/Scala, and hands-on with cloud data warehouses (Redshift/Snowflake) and distributed computing (Hadoop/Spark). They should be collaborative, able to mentor others, and comfortable operating in Agile teams.

Must-Have Skills

Bachelor's Degree4+ years of experience in application development2+ years of experience in big data technologies1+ year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

7+ years of application development including PythonSQL or Scala4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)4+ years real-time data/streaming4+ years NoSQL (MongoCassandra)4+ years data warehousing (Redshift or Snowflake)4+ years UNIX/Linux2+ years Agile engineering practices

Tools & Platforms

Amazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkMySQLMongoDBUNIX/LinuxAWSAzureGoogle Cloud Platform

Required Skills

JavaScalaPythonSQLNoSQLAmazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkMySQLUNIX/LinuxAgileAmazon Web ServicesMicrosoft AzureGoogle Cloud Platform

Hard Skills

JavaScalaPythonSQLNoSQLAmazon RedshiftSnowflakeHadoopHiveEMRKafkaSparkMySQLUNIX/LinuxAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformAgile

Soft Skills

CollaborationMentoringCommunicationProblem-solvingTeamworkCuriosityLearning mindset

Industry & Role

Industry Banking

Job Function Lead design and delivery of data engineering solutions in a Cloud/Big Data environment

Role Subtype Lead Data Engineer

Tech Domains Python, Java, Scala, SQL, NoSQL, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Apache Hadoop, Apache Spark, Kafka, Amazon Redshift, Snowflake, Unix/Linux, Agile

Clearance & Visa

Visa Sponsorship No

Keywords for Your Resume

lead data engineerdata engineercapital oneawsamazon web servicesazuregoogle cloud platformredshiftsnowflakehadoopkafkasparkpythonjavascalasqlnosqlbig datadata warehousingetlagileunix/linuxcloud computinglinuxLead Data EngineerData EngineerJavaPythonScalaAWSAmazon Web ServicesRedshiftSnowflakeSpark

Deal Breakers

Bachelor's degree required, Must be eligible to work in the United States without sponsorship, Location requirement in Plano, TX or ability to relocate to Plano

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile