Position Details
About this role
This role involves working on large-scale data engineering projects using Databricks and Apache Spark, providing technical leadership and consulting to clients in cloud environments.
Key Responsibilities
- Designing big data architectures
- Building reference architectures
- Guiding customer projects
- Supporting operational issues
- Collaborating with technical teams
Technical Overview
The technical environment includes Databricks platform, Apache Spark, cloud ecosystems (AWS, Azure, GCP), with a focus on data architecture, MLOps, and distributed computing.
Ideal Candidate
The ideal candidate is a senior data engineer with over 9 years of experience in data platforms and analytics, proficient in Python or Scala, with deep expertise in Apache Spark and cloud ecosystems like AWS, Azure, or GCP. They should have strong project delivery skills and experience with MLOps and CI/CD pipelines.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Certifications
Preferred
Industry & Role
Keywords for Your Resume
Deal Breakers
Less than 9 years of experience in data engineering, Lack of experience with Apache Spark, No cloud ecosystem knowledge, No programming in Python or Scala, No project delivery experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile