Position Details
About this role
Senior Data Engineer role responsible for designing, developing, implementing, optimizing, and maintaining data integrations, pipelines, and solutions. The role includes leading complex projects, mentoring engineers, collaborating with business partners, and ensuring data quality, security, and compliance in an Azure and on-premises environment.
Key Responsibilities
- Design, develop, implement, optimize, and maintain data integrations, pipelines, and solutions
- Build Azure-based data solutions using Azure Data Factory and Azure Synapse
- Optimize data ingestion pipelines and notebooks for scale, performance, reliability, and cost
- Design and test data mapping with transformation rules to ensure data quality and reliability
- Document data processes and solutions; ensure data security and compliance; mentor junior engineers
Technical Overview
You will build and optimize ETL and data warehousing solutions using Azure Data Factory, Azure Synapse, and ADLS, supported by SQL, Python, and PowerShell. Responsibilities include pipeline performance/cost optimization, integration connector support (APIs, SFTP/FTPS, streaming, DB connectors, SOAP/REST), and Git/Github-based CI/CD in an Agile/DevOps workflow.
Ideal Candidate
The ideal candidate is a senior data engineer with strong Azure data platform experience using Azure Data Factory and Azure Synapse, plus hands-on ETL and data warehousing development. They are proficient in SQL, Python, and PowerShell, and they have optimized data ingestion pipelines for scale, performance, reliability, and cost. They can lead complex projects independently and mentor other engineers in an Agile/DevOps environment.
Must-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Advanced proficiency in SQL, Python, and PowerShell, Proven experience with Azure Resources (Azure Data Factory, Azure Synapse, ADLS, etc), Experience with Git/Github for CI/CD, Agile development and DevOps best practices experience, Bachelor’s degree or higher in Data Science, Mathematics, Statistics
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile