Position Details

Salary $118K – $148K USD / year

Type Full-Time

Experience senior

Exp. Years 3-5 years

Education 3-5 years of experience in data engineering or software engineering with a strong focus on data platform development

Category Data & Analytics

About this role

This role involves designing and maintaining scalable data pipelines and platforms to support analytics, experimentation, and machine learning initiatives.

Key Responsibilities

Design data pipelines
Maintain data platform
Implement real-time streaming
Collaborate with teams
Ensure data quality

Technical Overview

Stack includes Python, SQL, cloud data warehouses like Snowflake and BigQuery, orchestration with Airflow, streaming with Kafka and Spark, container orchestration with Kubernetes, and infrastructure automation with Terraform.

Ideal Candidate

The ideal candidate is a senior data engineer with 3+ years experience in building scalable data pipelines, proficient in Python, SQL, and cloud data warehouses like Snowflake or BigQuery, with strong knowledge of orchestration and streaming technologies.

Must-Have Skills

PythonSQLbuilding data pipelinescloud data warehousesorchestration tools

Nice-to-Have Skills

real-time data pipelinesstreaming architecturesKubernetesTerraformDevOps

Tools & Platforms

SnowflakeBigQueryDatabricksApache AirflowKafkaKinesisKubernetesTerraform

Required Skills

PythonSQLSnowflakeBigQueryDatabricksDAG-based orchestratorsAirflowKafkaKinesisApache BeamFlinkSpark StreamingKubernetesTerraform

Hard Skills

PythonSQLSnowflakeBigQueryDatabricksDAG-based orchestratorsAirflowKafkaKinesisEvent HubsApache BeamFlinkSpark StreamingKubernetesArgoCDHelmIstioDevOpsTerraform

Soft Skills

communicationcollaborationproblem-solvinganalytical thinkingteamwork

Industry & Role

Industry E-commerce / Technology / Data Platforms

Job Function Build and optimize data pipelines and platforms for analytics and ML

Role Subtype Data Engineer

Tech Domains Python, SQL / PostgreSQL, Kubernetes, Terraform, Apache Beam

Keywords for Your Resume

data engineerPythonSQLdata pipelinescloud data warehousesSnowflakeBigQueryDatabricksAirflowKafkaKinesisKubernetesTerraformstreaming pipelinesDevOpsreal-time datadata platformETLdata architecture

Deal Breakers

Lack of experience with cloud data warehouses, No experience with data pipeline orchestration tools, Insufficient knowledge of streaming architectures, No proficiency in Python or SQL

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile