About this role
Lead the team building, owning, and sustaining the Xcel Vision Suite (XVS) data ecosystem and Databricks-based applications. Own data ingestion/landing into Databricks, establish engineering standards, and oversee operational reliability for XVS-owned systems not supported by Enterprise IT.
Key Responsibilities
- Own data engineering strategy and execution for XVS applications and pipelines not supported by Enterprise IT
- Lead data ingestion and landing into Databricks and scale solutions into durable capabilities
- Oversee incident triage and resolution, including monitoring/alerting and runbooks
- Manage engineering standards, delivery, and consultant handoffs with knowledge transfer
- Build Databricks-based pipelines and data applications including feature curation and Medallion architectures
Technical Overview
Manager role focused on Databricks pipeline and data application delivery, including data ingestion and landing for XVS-owned pipelines and Medallion (Bronze/Silver/Gold) transformations. Operates production systems with monitoring/alerting, runbooks, and incident triage, and partners with Product and Data Science teams to productionize capabilities and ensure sustainable support.
Ideal Candidate
The ideal candidate is a data engineering and applications leader who has managed teams building Databricks-based pipelines and production data services. They have deep experience with Medallion (Bronze/Silver/Gold) architectures, data ingestion/landing workflows, and operating systems via monitoring/alerting and runbooks to drive incident triage and root-cause prevention.
Must-Have Skills
Own data ingestion and landing into Databricks for XVS- owned pipelinesEnsure production-grade data services that are reliablemaintainableand scalableOversee incident triage and resolution for XVS-owned apps/pipelinesImplement monitoring/alertingrunbooksand root-cause preventionOversee data engineers and data application engineers building Databricks-based pipelines and data applicationsMedallion (Bronze/Silver/Gold) architectures aligned with Data Science needs
Tools & Platforms
Xcel Vision Suite (XVS)DatabricksPositStreamlit
Required Skills
data engineering strategydata ingestiondata landingDatabricksproduction-grade data servicescode qualityarchitecture patternstestingdocumentationdeployment practicesdata pipeline and service reliabilitymonitoring/alertingrunbooksroot-cause preventionincident triageincident resolutionMedallion (Bronze/Silver/Gold) architecturesfeature curation pipelinesDatabricks-native pipelinesPosit/Streamlit-style applicationsconsultant handoffsknowledge transferintegration with Enterprise IT
Hard Skills
data engineering strategydata ingestiondata landingDatabricksXVS- owned pipelinesdata pipeline architecturecode quality standardsarchitecture patternstestingdocumentationdeployment practicesdata pipeline and service reliability practicesroadmap planningproduction-grade data servicesmonitoringalertingrunbooksroot-cause preventionincident triageincident resolutionintegration across delivery teamsdata orchestrationmedallion architectures (Bronze/Silver/Gold)feature curation pipelinesdata engineersdata application engineersapplication deliveryconsultant handoffsknowledge transferengineering standards for maintainabilityscalable data servicesPosit/Streamlit-style applicationsDatabricks-native applications
Soft Skills
owning and sustaining engineering effortsmanaging delivery and consultant handoffscoordination with Enterprise ITknowledge transferpartnering with Product and Data Science teamsstakeholder managementmanaging incident resolution triage
Keywords for Your Resume
ManagerData & Applications EngineeringData and Applications EngineeringXcel Vision SuiteXVSintegrated planning platformdata ecosystemdata ingestiondata landingDatabricksdata engineering strategyproduction-grade data servicesreliablemaintainablescalablecode qualityarchitecture patternstestingdocumentationdeployment practicesdata pipeline and service reliabilityincident triageincident resolutionmonitoring/alertingrunbooksroot-cause preventionMedallion (Bronze/Silver/Gold)Medallion-layer transformationsfeature curation pipelinesDatabricks-nativePosit/Streamlit-style applicationsintegration bridgeEnterprise ITXcel Vision Suite (XVS)
Deal Breakers
Must be able to own data ingestion and landing into Databricks for XVS-owned pipelines, Must have experience overseeing Medallion (Bronze/Silver/Gold) architectures aligned with Data Science needs, Must be able to oversee incident triage and resolution for production XVS systems
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile