Position Details

Salary $99K – $198K USD / year

Type Not Specified

Experience senior

Exp. Years 5+ years

Education BS or MS in Computer Science or related field

Category Data & Analytics

About this role

This role involves developing scalable data pipelines, managing stream-processing systems, and mentoring junior engineers to support data infrastructure at Walmart/VIZIO.

Key Responsibilities

Design and implement ETL processes
Develop and maintain data pipelines
Work with cloud and stream-processing tools
Mentor junior team members
Optimize data workflows

Technical Overview

The technical environment includes SQL, NoSQL, AWS cloud services, stream-processing with Kafka, Spark, Storm, and data formats like Avro and Parquet, with a focus on data pipeline development and monitoring.

Ideal Candidate

The ideal candidate is a senior data engineer with 5+ years of experience in building data pipelines, working with cloud services like AWS, and expertise in stream-processing systems such as Kafka, Spark, and Storm.

Must-Have Skills

Experience with SQLNoSQLData pipeline developmentExperience with AWS cloud servicesStream-processing systemsData formats like AvroParquetJsonWorkflow tools like Apache AirflowAWS Data PipelineExperience with HadoopSparkKafkaMentoring junior team membersStrong PythonPysparkScala skills

Nice-to-Have Skills

Experience with data observability and monitoringExperience with cloud services like AWSKnowledge of software engineering practices

Tools & Platforms

AWSApache AirflowAWS Data PipelineHadoopSparkKafka

Required Skills

SQLNoSQLData PipelinesETLAWSPythonPysparkScalaData FormatsAvroParquetJsonStream-processingStormSparkKafkaApache AirflowAWS Data PipelineHadoop

Hard Skills

SQLNoSQLData PipelinesETLAWSPythonPysparkScalaData FormatsAvroParquetJsonStream-processingStormSpark-Structured-StreamingKafkaApache AirflowAWS Data PipelineHadoopSparkKafka

Soft Skills

Problem SolvingCollaborationTeamworkCommunicationTechnical Leadership

Industry & Role

Industry Retail / E-commerce

Job Function Build and maintain scalable data pipelines and support real-time data processing

Keywords for Your Resume

SQLNoSQLData PipelinesETLAWSPythonPysparkScalaData FormatsAvroParquetJsonStream-processingStormSparkKafkaApache AirflowAWS Data PipelineHadoop

Deal Breakers

Less than 5 years of experience, Lack of experience with SQL, NoSQL, and data pipelines, No experience with AWS or stream-processing systems, No familiarity with Hadoop, Spark, Kafka, Location outside of Denver, CO

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

(USA) Senior, Data Engineer

Get matched to jobs like this