Position Details

Type Not Specified

Experience senior

Exp. Years 8+ years

Education Bachelor's degree in Computer Science or Information Systems, or equivalent experience

Category Data & Analytics

About this role

This senior data engineer role involves developing and maintaining data pipelines, lakes, and warehouses, implementing security and governance, and supporting large-scale data infrastructure projects.

Key Responsibilities

Develop data pipelines
Maintain data lakes and warehouses
Implement security controls
Automate infrastructure provisioning
Support operational data pipelines

Technical Overview

Focuses on Python, PySpark, SQL, AWS, Terraform, Databricks, and infrastructure automation to build scalable, secure data ecosystems with operational support.

Ideal Candidate

The ideal candidate is an experienced data engineer with over 8 years of relevant experience, proficient in Python, PySpark, SQL, and cloud infrastructure, capable of designing and maintaining large-scale data lakes and warehouses with security and governance in mind.

Must-Have Skills

8+ years of relevant experienceProficiency in PythonPySparkSQLExperience with TerraformDesigning and maintaining data lakes and warehousesImplementing security controls and access management

Nice-to-Have Skills

Supply chain business processesContract manufacturingOperational support for ETL pipelinesCI/CD pipelines

Tools & Platforms

PythonPySparkSQLTerraformDatabricksAWSAmazon Web ServicesTerraformUnity CatalogIAMRBAC

Required Skills

PythonPySparkSQLAWSTerraformDatabricksUnity CatalogIAMRBACData pipelinesData lakesData warehousesCI/CDInfrastructure-as-CodeSecurity controlsData governance

Hard Skills

PythonPySparkSQLAWSAmazon Web ServicesTerraformDatabricksUnity CatalogIAMRBACCloud infrastructureData pipelinesData lakesData warehousesCI/CDInfrastructure-as-CodeSecurity controlsData governance

Soft Skills

LeadershipProblem-solvingCollaborationAnalytical skillsAttention to detail

Industry & Role

Industry Technology/Hardware

Job Function Design and maintain large-scale data infrastructure and pipelines

Keywords for Your Resume

PythonPySparkSQLAWSAmazon Web ServicesTerraformDatabricksUnity CatalogIAMRBACData pipelinesData lakesData warehousesCI/CDInfrastructure-as-CodeSecurity controlsData governance

Deal Breakers

Less than 8 years of experience, Lack of experience with cloud infrastructure and data lakes, Inability to work with Terraform or Databricks

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Data Engineer

Get matched to jobs like this