Position Details
About this role
Software Engineering Advisor focused on building data solutions and pipelines. Designs and maintains data models and pipelines using Spark/PySpark on Databricks, with Delta Lake and multi-cloud support.
Key Responsibilities
- Work with business and technical teams to understand data needs
- Design and document clear data solutions
- Build and support data pipelines using Spark and PySpark
- Create and maintain data models for reports and analytics
- Write SQL queries in Teradata
Technical Overview
Technical scope includes Spark, PySpark, Databricks, Teradata, SQL, Databricks Workflows, CI/CD, and cloud services (AWS). Familiarity with AI coding tools and Jira/Confluence for Agile collaboration.
Ideal Candidate
The ideal candidate is a mid-level data engineer with strong Spark, PySpark, Databricks and Teradata experience, skilled in SQL and Databricks Workflows; comfortable with Git, CI/CD, and Agile collaboration in a hybrid Austin environment.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Lack of Spark/PySpark/Databricks experience, Not located in or able to work in Austin, TX, Insufficient SQL and Databricks Workflows experience, Inability to work in a hybrid environment
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile