✦ Luna Orbit — AI & Machine Learning

Product Solutions Architect 3 - LLM Observability

at Datadog

📍 Boston, Massachusetts, USA; Denver, Colorado, USA; New York, New York, USA; San Francisco, California, USA Hybrid Posted March 11, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Not Specified
Experience mid
Exp. Years Not specified
Education Not specified
Category AI & Machine Learning

About this role

This role involves designing and implementing architectures for LLM observability, partnering with customers to deploy solutions, and providing technical guidance on large-scale AI applications.

Key Responsibilities

  • Partner with customers on architecture design
  • Create reference architectures and guides
  • Build proofs of concept
  • Drive adoption of LLM observability
  • Provide technical feedback to product teams

Technical Overview

The technical environment includes distributed systems, observability tools such as tracing, metrics, logging, and programming in Python, JavaScript, and TypeScript, focused on LLM-powered applications.

Ideal Candidate

The ideal candidate is a mid-level solutions architect with strong software engineering skills, experience with LLMs, distributed systems, and observability tools, capable of guiding customer deployments and designing scalable architectures.

Must-Have Skills

Software EngineeringLLMDistributed SystemsObservabilityPythonJavaScriptTypeScript

Nice-to-Have Skills

Reference architecturesTechnical guidesCustomer deploymentsProof of conceptReal-world customer insights

Tools & Platforms

Datadog LLM ObservabilityPythonJavaScriptTypeScript

Required Skills

Software EngineeringLarge Language ModelsDistributed SystemsObservabilityPythonJavaScriptTypeScript

Hard Skills

Software EngineeringLLMLarge Language ModelsDistributed SystemsObservabilityTracingMetricsLoggingPythonJavaScriptTypeScriptArchitectural GuidanceCustomer Deployment

Soft Skills

Customer engagementTechnical guidanceArchitectural designCollaborationDeep technical understandingOwnership

Industry & Role

Industry SaaS
Job Function Design and deliver scalable architectures for LLM observability and customer deployment support.

Keywords for Your Resume

Product Solutions ArchitectLLM ObservabilityLarge Language ModelsDistributed SystemsObservabilityTracingMetricsLoggingPythonJavaScriptTypeScriptArchitectural GuidanceCustomer DeploymentLLM

Deal Breakers

Lack of experience with distributed systems or observability, No background in software engineering or LLM applications, Unfamiliarity with SaaS or cloud environments

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile