About this role
Senior data/AI-focused solutions architect leading end-to-end cloud-native data architecture designs and ML/AI enablement in multi-cloud environments. Responsible for security standards, data governance, and stakeholder mentorship.
Key Responsibilities
- Design end-to-end data lakehouse architectures on Databricks Spark and Delta Lake
- Enable ML/AI capabilities with MLflow, TensorFlow, PyTorch
- Define security standards including RBAC, SCIM, SAML, SSO
- Ensure compliance deploying in customer-controlled VPCs
- Provide leadership, documentation, and mentorship
Technical Overview
Stack includes Databricks, Spark, Delta Lake, MLflow, TensorFlow, PyTorch; cloud providers AWS/Azure/GCP; RBAC Unity Catalog; security, VPCs, and BI integration; strong documentation and leadership.
Ideal Candidate
The ideal candidate is a senior resident solutions architect with 8+ years of data & cloud architecture experience, proficient with Databricks, Spark, Delta Lake, and Unity Catalog. Must be comfortable designing secure, cloud-native architectures across AWS, Azure, and Google Cloud, and able to lead data governance and BI tool integration in government/enterprise contexts.
Must-Have Skills
Bachelor’s degree in Computer ScienceEngineeringor related field8+ years of experience in solutions architecturedata engineeringor related rolesStrong expertise in DatabricksApache Sparkand Delta LakeExperience designing securecloud-native architectures (AWSAzureor GCP)Hands-on experience with SQLPythonRor ScalaDeep understanding of ACID transactionsdata versioningand point-in-time queryingPractical experience with AI/ML model developmentdeploymentor integrationExperience with data governancesecurity controlsand RBAC using Unity CatalogStrong communication skills
Nice-to-Have Skills
Experience supporting large-scale federal or healthcare data platformsFamiliarity with ML/AI tools (MLflowTensorFlowPyTorchXGBoost)Knowledge of CI/CD pipelinesGitHub integrationand DevOps best practicesExperience with BI and visualization tools (Power BITableauMicroStrategyQlik)Databricks certification (e.g.Databricks Certified Solutions ArchitectDatabricks Certified Data Engineer)Relevant cloud certifications (AWS Solutions ArchitectAzure Solutions ArchitectDatabricks Certified Architect)
Tools & Platforms
DatabricksTableauPower BIAmazon Web ServicesAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformUnity CatalogMLflowTensorFlowPyTorch
Required Skills
DatabricksApache SparkDelta LakeMLflowTensorFlowPyTorchPythonSQLRScalaUnity CatalogRBACSCIMSAMLSSOBI toolsTableauPower BIAWSAmazon Web ServicesAzureGoogle Cloud PlatformVPCdata governanceCI/CD
Hard Skills
DatabricksApache SparkDelta LakeSQLPythonRScalaMLflowTensorFlowPyTorchRBACSCIMSAMLSSOUnity CatalogTableauPower BIAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformVPCData governanceCI/CD pipelines
Soft Skills
communicationleadershipmentorshipstakeholder engagementdocumentationteamworkproblem-solving
Certifications
Required
Databricks Certified Solutions ArchitectDatabricks Certified Data EngineerAWS Solutions Architect – AssociateAzure Solutions ArchitectDatabricks Certified Architect
Preferred
Databricks Certified Solutions ArchitectDatabricks Certified Data EngineerAWS Solutions Architect – AssociateAzure Solutions ArchitectDatabricks Certified Architect
Keywords for Your Resume
Resident Solutions ArchitectDatabricksApache SparkDelta Lakedata lakehouseMLflowTensorFlowPyTorchRBACSCIMSAMLSSOUnity CatalogTableauPower BIAmazon Web ServicesAWSMicrosoft AzureGoogle Cloud PlatformGoogle CloudVPCPublic Trust clearanceU.S. CitizenshipDatabricks certificationCI/CD pipelinesSecurityData governancedatabricksapache sparkdelta lakemlflowtensorflowpytorchrbacunity catalogsamlsso
Deal Breakers
Must be a U.S. Citizen or Green Card holder with ability to obtain Public Trust clearance
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile