About this role
Principal Architect - Cloud and Observability owns the architecture and standards for CVS Health's observability platforms and hybrid cloud posture. The role is hands-on, shaping telemetry, instrumentation, and cost optimization across multi-cloud and on-prem environments.
Key Responsibilities
- Own enterprise observability reference architecture across metrics, logs, traces, and events
- Drive the OpenTelemetry-first instrumentation strategy
- Build and operate telemetry pipelines on Grafana Mimir, Loki, Tempo
- Define SLOs/SLIs and alerting frameworks
- Own telemetry tooling integration with ServiceNow ITOM and xMatters
Technical Overview
Responsible for OpenTelemetry-first instrumentation, telemetry pipelines on Grafana Mimir/Loki/Tempo, multi-cloud reference architectures (OpenShift on-prem, Azure, AWS, GCP), and integration with incident management. Uses IaC (Terraform, Pulumi, Helm, ArgoCD) and cloud-native IAM patterns.
Ideal Candidate
The ideal candidate is a senior cloud/observability architect with 10+ years in infrastructure and cloud, 5+ years Kubernetes and OpenTelemetry experience, and proven success delivering enterprise observability across hybrid on-prem and cloud environments.
Must-Have Skills
10+ years in infrastructurecloud architectureplatform engineeringor SRE8+ years of architecture work in observabilitycloud infrastructureor both at a large enterpriseSolid experience with at least two of AzureAWSor GCP -- including networkingidentitycomputeand storage5+ years with Kubernetes in production (OpenShiftEKSAKSor GKE)5+ years with OpenTelemetry or similar frameworks (collectorsSDKssemantic conventionspipeline design)5+ years with observability platforms: Grafana/Mimir/Loki/TempoPrometheusDatadogSplunkDynatraceor comparable toolsExperience defining SLOs/SLIs and building alerting strategies at an organizational levelProven track record writing architecture standards that other teams adopted and followedAble to communicate clearly with both engineers and senior leadership
Nice-to-Have Skills
On-prem / private cloud experience (OpenShift VirtualizationKVM/libvirtVMwareDell PowerFlex or similar storage)Workload identity (SPIFFE/SPIRE) and zero-trust networkingInfrastructure-as-code (TerraformPulumiHelmArgoCD)Streaming platforms such as Kafka or Confluentespecially in telemetry pipeline contextsAIOps or ML-based anomaly detection experienceFinOps background -- cloud cost optimizationchargebackunit economicsService mesh (IstioEnvoyLinkerd) or eBPF-based tools (CiliumPixie)Involvement in open-source communities (CNCFOpenTelemetryetc.)Healthcareinsuranceor financial services experience (HIPAA/SOX familiarity)Cloud certifications are a plus but not required
Tools & Platforms
ServiceNow ITOMGrafanaOpenTelemetryKubernetesOpenShiftAmazon Web ServicesMicrosoft AzureGoogle Cloud PlatformTerraformPulumiHelmArgoCDKafkaConfluentSPIFFE/SPIREServiceNowxMatters
Required Skills
OpenTelemetryGrafanaMimirLokiTempoDatadogSplunkDynatracePrometheusKubernetesOpenShiftEKSAKSGKEAzureAmazon Web ServicesGoogle Cloud PlatformTerraformPulumiHelmArgoCDKafkaConfluentSPIFFESPIREServiceNow ITOMxMattersFinOpsAPIsCI/CD
Hard Skills
OpenTelemetryGrafanaMimirLokiTempoDatadogSplunkDynatracePrometheusKubernetesOpenShiftEKSAKSGKEAzureAmazon Web ServicesGoogle Cloud PlatformTerraformPulumiHelmArgoCDAPIs
Soft Skills
LeadershipCommunicationStakeholder ManagementMentoringCollaborationProblem-solvingStrategic ThinkingPublic SpeakingInfluenceChange Management
Certifications
Preferred
Cloud certifications are a plus but not required
Keywords for Your Resume
OpenTelemetryGrafanaMimirLokiTempoDatadogSplunkDynatracePrometheusKubernetesOpenShiftEKSAKSGKEAzureAmazon Web ServicesGoogle Cloud PlatformTerraformPulumiHelmArgoCDAPIs
Deal Breakers
Less than 10 years in infrastructure/cloud architecture or observability, No 5+ years of Kubernetes in production, No OpenTelemetry experience or lack of familiarity with Grafana/Mimir/Loki/Tempo
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile