Position Details

Type Full-Time

Experience senior

Exp. Years Not specified

Education Not specified

Category Data & Analytics

About this role

This role involves designing, developing, and maintaining data pipelines and infrastructure for real-time and batch processing, primarily utilizing cloud platforms like AWS, Azure, and GCP.

Key Responsibilities

Design and maintain ETL/ELT pipelines
Build automated data ingestion workflows
Implement data transformation and validation
Optimize pipeline performance
Develop monitoring and alerting systems

Technical Overview

The technical environment includes ETL/ELT pipelines, cloud storage solutions, data modeling, and automation tools, with a focus on data quality, security, and performance optimization.

Ideal Candidate

The ideal candidate is a senior data engineer with extensive experience designing and maintaining ETL/ELT pipelines, proficient in cloud platforms such as AWS, Azure, or GCP, and skilled in data modeling, quality, and governance. They should have a strong background in data infrastructure and automation.

Must-Have Skills

ETLData pipeline developmentCloud platformsAWSAzureGCPData modelingData quality frameworksData governanceDevOpsCI/CD

Nice-to-Have Skills

Data lake architecturesData ingestion workflowsStreaming platformsData transformation logicMonitoring and alerting systems

Tools & Platforms

AWSAzureGoogle Cloud PlatformAPIsDatabases

Required Skills

ETLELTData pipeline developmentAPIsDatabasesCloud platformsAWSAzureGCPData modelingData qualityData governanceDevOpsCI/CD

Hard Skills

ETLELTData Pipeline DevelopmentData ingestion workflowsAPIsDatabasesFlat filesStreaming platformsData transformationData cleansingData validationData enrichmentPipeline performance optimizationMonitoring and alerting systemsData warehouseData lakeCloud platformsAWSAzureGoogle Cloud PlatformData modelingData quality frameworksData lineageMetadata managementData privacy regulations (GDPRCCPA)Security measures (encryptionaccess controlsaudit logging)DevOpsCI/CD

Soft Skills

collaborationcommunicationproblem-solvinganalytical thinkingmentoringteamworkadaptability

Industry & Role

Industry Manufacturing

Job Function Data pipeline development and data infrastructure management

Keywords for Your Resume

Data EngineerETLELTData pipelineData ingestionAPIsDatabasesStreaming platformsData transformationData cleansingData validationData enrichmentData warehouseData lakeAWSAzureGCPData modelingData qualityData governanceDevOpsCI/CD

Deal Breakers

Lack of experience with cloud platforms (AWS, Azure, GCP), No experience with data pipeline development, No knowledge of data governance or security measures, Not familiar with DevOps or CI/CD practices

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Data Engineer Senior

Get matched to jobs like this