✦ Luna Orbit — Data & Analytics

Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

at Discover Financial Services

📍 McLean, VA Unknown 💰 $229K – $262K USD / year Posted March 26, 2026
Apply Now → ← Browse All Jobs

Position Details

Salary $229K – $262K USD / year
Type Full-Time
Experience senior
Exp. Years 6+ years
Education Bachelor's in Computer Science or related field
Category Data & Analytics

About this role

This role involves leading data engineering efforts focused on real-time data streaming, building scalable data pipelines, and leveraging cloud data platforms like Snowflake and DynamoDB.

Key Responsibilities

  • Design and implement data pipelines
  • Manage real-time data streams
  • Optimize data storage
  • Collaborate with data teams
  • Mentor junior engineers

Technical Overview

The technical environment includes Python, SQL, Spark, Kafka, DynamoDB, Snowflake, and Databricks, with an emphasis on big data processing and streaming applications.

Ideal Candidate

The ideal candidate is a senior data engineer with 6+ years of experience in big data, cloud platforms, and data streaming technologies. They are proficient in Python, Spark, Kafka, DynamoDB, and Snowflake, with a focus on real-time data processing.

Must-Have Skills

Bachelor's Degreeat least 6 years of experience in application developmentexperience in big data technologiesexperience with cloud computing (AWSMicrosoft AzureGoogle Cloud)

Nice-to-Have Skills

Master's Degreeexperience leveraging AI-assisted coding tools (Claude CodeGitHub Copilot)9+ years of experience in application development including PythonSQLSparkETL toolsAWS Glue4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)5+ years experience with distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkMySQL)4+ years of experience with real-time data and streaming applications

Tools & Platforms

SnowflakeDynamoDBDatabricksAWSAmazon Web ServicesKafkaGenAIbig data technologiesdata pipelines

Required Skills

PythonSQLSparkKafkaSnowflakeDynamoDBDatabricksGenAIbig data technologiesdata pipelinesstreaming applications

Hard Skills

PythonSQLSparkKafkaSnowflakeDynamoDBDatabricksGenAIbig data technologiesdata pipelinesstreaming applications

Soft Skills

collaborationteamworkproblem-solvingmentoringlearningcommunication

Industry & Role

Industry Fintech
Job Function Lead data engineering projects with a focus on real-time data and cloud platforms
Role Subtype Data Engineer
Tech Domains Python, SQL / PostgreSQL, Amazon Web Services, Spark, Snowflake, DynamoDB, Databricks

Clearance & Visa

Clearance Required None
Visa Sponsorship No

Keywords for Your Resume

senior data engineerpythonsqlsparkkafkasnowflakedynamodbdatabricksgenaibig data technologiesdata pipelinesstreaming applicationscloud computingbig data

Deal Breakers

Less than 6 years of experience in application development, No experience with big data or cloud platforms, Lack of experience with streaming applications

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile