Position Details
About this role
This role is for a Lead Data Engineer supporting Capital One Enterprise Platforms Technology (EPTech), including platforms for hyper-personalized omnichannel marketing and messaging. You will design and deliver full-stack data solutions using big data technologies and cloud data warehousing services.
Key Responsibilities
- Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
- Work with distributed microservices and full stack systems with machine learning experience
- Use Java, Scala, Python plus Open Source RDBMS and NoSQL databases and cloud data warehousing (Redshift, Snowflake)
- Perform unit tests and conduct reviews, ensuring code is rigorously designed and performance tuned
- Mentor engineers and collaborate with digital product managers on robust cloud-based solutions
Technical Overview
You will build and support data engineering solutions using Java, Scala, Python with Open Source RDBMS and NoSQL databases, leveraging cloud data warehousing like Redshift and Snowflake. The stack emphasizes distributed computing tools (MapReduce, Hadoop, Hive), machine learning, cloud computing, and Agile delivery with unit tests and performance tuning.
Ideal Candidate
The ideal candidate is a lead data engineer with 4+ years of application development experience and 2+ years of big data technologies experience, plus at least 1 year working with cloud computing on AWS, Microsoft Azure, or Google Cloud. They are strong in data engineering fundamentals like distributed computing (MapReduce, Hadoop, Hive) and cloud data warehousing (Amazon Redshift, Snowflake), and can build and review robust code using Agile team practices.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Clearance & Visa
Keywords for Your Resume
Deal Breakers
Bachelor's Degree, At least 4 years of experience in application development (internship experience does not apply), At least 2 years of experience in big data technologies, At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud), No immigration authorization/sponsorship for this position
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile