Position Details

Salary $120K – $140K USD / year

Type Full-Time

Experience mid

Exp. Years 2-4 years

Education Not specified

Category Data & Analytics

About this role

This role involves developing and optimizing data pipelines for analytics and machine learning workloads, ensuring platform reliability, and collaborating with data scientists and analysts.

Key Responsibilities

Develop data pipelines
Maintain data workflows
Collaborate with data scientists
Optimize data platform performance
Ensure data quality

Technical Overview

The technical environment includes Python, SQL, Databricks, Spark, cloud platforms (AWS, Azure, GCP), and data warehousing tools, focusing on building scalable data workflows.

Ideal Candidate

The ideal candidate is a mid-level data engineer with 2+ years of experience in building and maintaining data pipelines, proficient in Python, SQL, and cloud platforms like AWS, Azure, or GCP. They should have hands-on experience with Databricks or Spark and a strong understanding of data modeling and warehousing.

Must-Have Skills

PythonSQLData pipeline developmentETL/ELT workflowsExperience with Databricks or SparkExperience with cloud platforms (AWSAzureGCP)

Nice-to-Have Skills

Data ingestion from APIsData quality practicesMonitoring and debugging data pipelinesData platform optimization

Tools & Platforms

DatabricksSparkAWSAzureGCPGit

Required Skills

PythonSQLDatabricksSparkAPIsCloud platforms such as AWSAzureGCPData modelingData warehousingETL workflowsVersion control (Git)

Hard Skills

PythonSQLDatabricksSparkAPIsCloud platforms such as AWSAzureGCPData modelingData warehousingETL/ELT workflowsVersion control (Git)

Soft Skills

CollaborationProblem-solvingCommunicationDocumentationTeamwork

Industry & Role

Industry SaaS

Job Function Build and maintain scalable data pipelines for analytics and machine learning

Role Subtype Data Engineer

Tech Domains Python, SQL / PostgreSQL, Databricks, Spark, Amazon Web Services, Azure, Google Cloud Platform

Keywords for Your Resume

Data EngineerPythonSQLDatabricksSparkAPIsCloud platformsData pipelinesETL workflowsData modelingData warehousingVersion controlData qualityData ingestionData platformMachine learning workflowsData engineer

Deal Breakers

Lack of experience with data pipelines or ETL workflows, No experience with cloud platforms (AWS, Azure, GCP), No proficiency in Python or SQL, No experience with Databricks or Spark

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile