Position Details
About this role
This role involves designing and maintaining large-scale data platforms for vehicle telematics data, supporting analytics and machine learning initiatives.
Key Responsibilities
- Develop scalable data platforms
- Build and maintain data pipelines
- Support ML development
- Implement data governance and quality
- Lead data engineering initiatives
Technical Overview
The technical environment includes Python, Scala, Spark, Kafka, Azure Data Lake, Kubernetes, and data governance tools, focusing on scalable data pipeline development and data quality management.
Ideal Candidate
The ideal candidate is a senior data engineer with over 5 years of experience in building large-scale data platforms using Python or Scala, with expertise in Spark, Kafka, and cloud data storage solutions like Azure Data Lake. They should have strong leadership skills and experience with data governance and MLOps practices.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Less than 5 years of data engineering experience, No experience with Spark or distributed data processing, Lack of cloud platform experience, especially Azure, Unwilling to work in a hybrid environment
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile