Position Details

Salary $105K – $125K USD / year

Type Full-Time

Experience senior

Exp. Years 3+ years

Education Bachelor’s degree in Computer Science, Information Technology or equivalent work experience.

Category Data & Analytics

About this role

Remote Data Engineer role focused on building and optimizing Spark-based data pipelines in a healthcare context, leveraging cloud platforms and RDBMS to deliver data integration and quality for analytics.

Key Responsibilities

Create, maintain and execute Spark scripts; Create and maintain SQL scripts; Optimize queries; Perform data analysis; Troubleshoot with cross-functional teams

Technical Overview

Hands-on with Spark, Databricks, multiple cloud providers (AWS/Azure/GCP), and RDBMS (Oracle, MS SQL). Experience with data analysis, data pipelines, and orchestration tools (Airflow, Databricks Workflows) in healthcare data domains.

Ideal Candidate

The ideal candidate is a senior data engineer with 3+ years of big data and cloud experience (Spark, Databricks, AWS/Azure/GCP) and healthcare data exposure (claims/enrollment). They should be proficient with data pipeline orchestration (Airflow) and RDBMS (Oracle, MS SQL) with strong problem-solving and communication skills.

Must-Have Skills

Bachelor’s degree in Computer ScienceInformation Technology or equivalent work experience.3+ years of working knowledge of big data technologies (SparkS3KafkaRayHadoopetc.).3+ years of working knowledge of cloud technologies (DatabricksAWSAzureHadoopSparkSnowflake).3+ years of working knowledge of cloud (AWSAzureGCPOCI).3+ years of working knowledge of RDBMS (OracleMS SQLVertica) and experience using SQLPL/SQL or other data integration/ETL tools.

Nice-to-Have Skills

Any Databricks / AWS certificationsFamiliarity with data pipeline orchestration tools (AirflowDatabricks Workflows)

Required Skills

Bachelor’s degree in Computer ScienceInformation Technology or equivalent work experience; 3+ years of big data tech (SparkS3KafkaRayHadoop); 3+ years cloud tech (DatabricksAWSAzureHadoopSparkSnowflake); 3+ years cloud (AWSAzureGCPOCI); 3+ years of RDBMS (OracleMS SQLVertica) with SQL/PLSQL; familiar with data pipelinesAirflowJira

Hard Skills

SparkDatabricksAWSAzureGoogle Cloud PlatformSQLMS SQLOracleAirflowDatabricks WorkflowsJIRA

Soft Skills

Strong analytical skillsExcellent verballistening and written communicationAbility to multitask and prioritizeIndependent and team-orientedProblem-solving

Industry & Role

Industry Healthcare & Medical

Job Function Develop and optimize data pipelines and analytics infrastructure in a remote, healthcare-focused environment

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Google Cloud Platform, Azure, SQL / PostgreSQL, Oracle

Keywords for Your Resume

data engineersparkdatabricksawsamazon web servicesazuregoogle cloud platformsqlms sqloraclerdbmsplsqlairflowdatabricks workflowshealthcarehealthcare claimspharmacy claimsdata pipelinesdata analysisjiraremotesenior

Deal Breakers

Less than 3 years of relevant experience, No healthcare data experience, No cloud platform experience (AWS/Azure/GCP)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Data Engineer - AI (Spark, Databricks and Healthcare)

Get matched to jobs like this