About this role
AI & Data Platform Lead Architect to design and deliver a large-scale healthcare data platform with AI enablement, leading cross-functional teams to ensure scalability, reliability, and compliance.
Key Responsibilities
- Lead end-to-end architecture of data and AI platform; design ingestion/transformation/storage pipelines; define data models; guide AI/ML integrations; mentor cross-functional teams
Technical Overview
End-to-end architecture of data pipelines, data models, and AI integration (LLMs, RAG, embeddings); use of Snowflake/Databricks/BigQuery; ETL/ELT tooling; cloud platforms; HIPAA-compliant data handling.
Ideal Candidate
The ideal candidate is a senior technical leader with 10+ years in data engineering/architecture, experienced building large-scale healthcare data platforms end-to-end, and proficient with Snowflake/Databricks/BigQuery, ETL tools, and cloud platforms (AWS/Azure). They excel at cross-functional leadership and communicating complex data solutions to stakeholders.
Must-Have Skills
10+ years of experience in data engineeringsoftware engineeringor data architectureProven experience leading delivery of large-scale healthcare data platforms end-to-end.Strong expertise in data architecture and pipeline design (batch and/or streaming)Advanced proficiency in SQL and Python (or similar languages)Hands-on experience with modern data platforms such as: SnowflakeDatabricksBigQueryor similarExperience in the healthcare arena with payor/provider/claims/PHI/HIPAA data.Experience with ETL/ELT tools such as: AirflowdbtAzure Data Factoryor equivalentStrong experience in at least one major cloud platform: AWSAzureExperience leading and mentoring cross-functional technical teamsAbility to communicate effectively with both technical and non-technical stakeholders
Nice-to-Have Skills
Experience working with AI/ML systems or LLM integrations (RAGvector databasesembeddings)Experience with data streaming technologies (KafkaSpark Streamingetc.)Background in healthcare datafinancial dataor large-scale enterprise data environmentsExperience with data governancesecurityand compliance frameworksFamiliarity with data observability and monitoring tools
Tools & Platforms
SnowflakeDatabricksBigQueryAirflowdbtAzure Data FactoryAmazon Web ServicesAzurePythonSQL / PostgreSQL
Required Skills
10+ years data engineering/architecture; healthcare data platform experience; data ingestion; ETL/ELT; Snowflake; Databricks; BigQuery; SQL; Python; Airflow; dbt; Azure Data Factory; AWS; HIPAA/PHI
Hard Skills
data engineeringsoftware engineeringdata architectureETL/ELTdata ingestiontransformationSQLPythonSnowflakeDatabricksBigQueryAzure Data FactoryAirflowdbtAWSAzureHIPAAPHIdata governancedata observabilityvector databasesLLM integrationsRAG
Soft Skills
leadershipmentoringcross-functional collaborationcommunicationstakeholder managementproblem-solvingdecision making
Keywords for Your Resume
ai & data platform lead architectdata platformetl/eltdata ingestiondata modelingai mlllmragembeddingssnowflakedatabricksbigqueryawsazureetldata governancehealthcarephihipaadata observabilitylead architectcross-functionaldata engineeringllm integrationshealthcare data
Deal Breakers
Lack of 10+ years of data platform experience, Inability to work on healthcare data with PHI/HIPAA requirements
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile