Position Details

Type Full-Time

Experience senior

Exp. Years 5+ years

Education Bachelor's Degree in Computer Science, Data Analytics, Engineering, Operations Management or related field

Category Data & Analytics

About this role

Own the full lifecycle of business requirement understanding and data migration into a Databricks environment. Architect, implement, and optimize secure, reliable ETL/ELT data flows and data models for business analytics across vehicle development through production.

Key Responsibilities

Architect and lead ETL/ELT strategy for migration and analytics-ready data flows
Design and maintain batch and real-time data pipelines to Databricks
Model and optimize data structures for data lakes and data warehousing
Automate and monitor workflows for reliability, transparency, and fault tolerance
Document data flows, transformation logic, and technical specifications

Technical Overview

Leads ETL/ELT architecture and scalable data pipelines using Databricks (PySpark, Databricks SQL) and Lakehouse concepts. Integrates and models data from Oracle, SQL Server, MySQL, Teradata, and Snowflake, with monitoring, automation, and documentation for secure, compliant analytics-ready outputs.

Ideal Candidate

The ideal candidate is a senior data engineer with 5+ years building and optimizing ETL/ELT pipelines and leading database migrations into Databricks lakehouse environments. They have deep hands-on experience with Oracle, SQL Server, MySQL, Teradata, and Snowflake, plus strong PySpark and Databricks SQL skills. They can design scalable, secure, compliant data flows and deliver well-documented, monitored workflows across cross-functional automotive business teams.

Must-Have Skills

5+ years of experience in data engineering or related rolesdemonstrated expertise in database migrations and ETL/ELT process designDeep hands-on experience with databases OracleSQL ServerMySQLTeradataSnowflakein-depth knowledge of Databricks (including PySparkDatabricks SQLand Lakehouse architectures)Expertise in ETL/ELT tools and frameworks (e.g.InformaticaTalendDatabricks Workflowsor custom pipelines)Proven ability to design and implement scalableefficient data pipelines and to optimize complex transformations in modern cloud environmentsDemonstrated experience in data modeling

Tools & Platforms

DatabricksPySparkDatabricks SQLLakehouse architecturesInformaticaTalendDatabricks WorkflowsOracleSQL ServerMySQLTeradataSnowflake

Required Skills

ETL/ELTDatabricksPySparkDatabricks SQLLakehouse architecturesInformaticaTalendDatabricks WorkflowsOracleSQL ServerMySQLTeradataSnowflakedata pipelinesdata modelingdata lakesdata warehousingdata securitydata qualitydata compliancefault tolerance

Hard Skills

ETL/ELTETL architectureELT architectureExtractionTransformationData loading strategiesData pipeline designData pipeline developmentBatch and real-time methodologiesScalabilityPerformance optimizationData integrityData securityData qualityData complianceData modelingData lakeData warehousingDatabricksPySparkDatabricks SQLLakehouse architecturesInformaticaTalendDatabricks WorkflowsOracleSQL ServerMySQLTeradataSnowflakeAutomate data workflowsMonitor data workflowsFault toleranceDocumentation of data flowsTransformation logicTechnical specifications

Soft Skills

customer focusdrive for resultsease with ambiguous data requests and definitionsinfluences changeownership for project deliverablesexplores opportunities to add valuecross-functional collaboration

Industry & Role

Industry Manufacturing

Job Function Design and migrate business intelligence data into Databricks using scalable ETL/ELT pipelines and lakehouse data models

Role Subtype Data Engineer

Tech Domains Python, SQL / PostgreSQL, Azure, Amazon Web Services, Google Cloud Platform, Data & Analytics

Keywords for Your Resume

Senior Business Intelligence Data EngineerSr. Business Intelligence Data EngineerBusiness Intelligence Data EngineerETL/ELTETL architectureELT architecturedata pipelinesdata pipeline developmentbatchreal-timeDatabricksPySparkDatabricks SQLLakehouse architecturesInformaticaTalendDatabricks WorkflowsOracleSQL ServerMySQLTeradataSnowflakedata modelingdata lakesdata warehousingdata securitydata qualitydata compliancefault tolerance

Deal Breakers

Bachelor's degree in Computer Science, Data Analytics, Engineering, Operations Management or related field, 5+ years of experience in data engineering with demonstrated database migration and ETL/ELT design, Deep hands-on experience with Oracle, SQL Server, MySQL, Teradata, Snowflake, In-depth knowledge of Databricks including PySpark, Databricks SQL, and Lakehouse architectures

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile