Position Details

Salary $179K – $204K USD / year

Type Full-Time

Experience mid

Exp. Years 2+ years in big data, 1+ year in cloud

Education Bachelor's Degree

Category Data & Analytics

About this role

Mid-level Data Engineer responsible for designing and supporting data pipelines, data warehousing, and streaming applications within Capital One's data ecosystem, leveraging cloud platforms and big data tools.

Key Responsibilities

Design data pipelines
Implement streaming solutions
Optimize data warehouse performance
Collaborate with data teams
Support cloud data infrastructure

Technical Overview

Focus on data engineering, cloud data warehousing, distributed systems, and streaming data, utilizing tools like Redshift, Snowflake, Hadoop, Kafka, and Spark in a financial services environment.

Ideal Candidate

The ideal candidate is a mid-level data engineer with at least 2 years of experience in big data technologies, cloud computing, and data warehousing. They are proficient in Python, SQL, Scala, and Java, with a strong understanding of distributed systems and streaming data.

Must-Have Skills

Bachelor's Degree4+ years in application development2+ years in big data technologies1+ year in cloud computing

Nice-to-Have Skills

7+ years in application developmentExperience with PythonSQLScalaJavaExperience with AWSAzureGoogle CloudExperience with distributed data toolsExperience with real-time data and streamingExperience with NoSQL databasesData warehousing experienceUnix/Linux scriptingAgile practices

Tools & Platforms

RedshiftSnowflakeAWSAzureGoogle CloudHadoopKafkaSparkMongoDBCassandraUnix/LinuxShell Scripting

Required Skills

Data EngineeringPythonSQLScalaJavaRedshiftSnowflakeBig DataDistributed DataStreaming ApplicationsNoSQLCloud ComputingHadoopKafkaSparkUnix/LinuxShell Scripting

Hard Skills

Data EngineeringPythonSQLScalaJavaOpen Source RDBMSNoSQLRedshiftSnowflakeCloud ComputingDistributed DataStreaming ApplicationsShell ScriptingUnix/LinuxAgile

Soft Skills

CollaborationProblem SolvingMentoringTeamworkCommunicationAdaptabilityContinuous Learning

Certifications

Preferred

AWS Certified Solutions ArchitectGoogle Cloud Professional EngineerAzure Solutions Architect

Industry & Role

Industry Financial Services, Data Warehousing, Cloud Computing

Job Function Building and maintaining data pipelines and warehouses in a cloud-based environment

Role Subtype Data Engineer

Tech Domains Java, Scala, Python, AWS, Microsoft Azure, Google Cloud, Hadoop, Kafka, Spark, NoSQL

Keywords for Your Resume

Data EngineeringPythonSQLScalaJavaRedshiftSnowflakeBig DataDistributed DataStreaming ApplicationsNoSQLCloud ComputingHadoopKafkaSparkUnix/LinuxShell ScriptingAgile

Deal Breakers

Less than 2 years in application development, No experience with big data technologies, Lack of cloud computing experience, No experience with data warehousing, No proficiency in Python, SQL, Scala, or Java

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead Data Engineer

Get matched to jobs like this