Position Details
About this role
This role involves working with clients on big data projects using the Databricks platform, providing data engineering, data science, and cloud solutions. The focus is on designing architectures, deploying AI applications, and ensuring successful project delivery.
Key Responsibilities
- Designing and building reference architectures
- Creating how-to guides and productionalizing use cases
- Consulting on architecture and design
- Supporting operational issues
- Collaborating with technical teams
Technical Overview
Technical environment includes Databricks, Apache Spark, cloud platforms (AWS, Azure, GCP), with a focus on distributed computing, data architecture, MLOps, and CI/CD pipelines.
Ideal Candidate
The ideal candidate is a senior data engineer with over 9 years of experience in data platforms and analytics, proficient in Python or Scala, with deep expertise in distributed computing using Apache Spark and cloud ecosystems like AWS, Azure, or GCP. They should have strong project delivery skills and experience working directly with clients on complex big data projects.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Certifications
Preferred
Industry & Role
Keywords for Your Resume
Deal Breakers
Less than 9 years of experience in data engineering, Lack of experience with Apache Spark, No cloud ecosystem knowledge (AWS, Azure, GCP), No experience with MLOps or CI/CD, Inability to work remotely in Texas
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile