✦ Luna Orbit — AI & Machine Learning

AI Platform Engineer, Applied AI

at Circle.so

📍 Remote, US Remote 💰 $130K – $140K USD / year Posted March 25, 2026
Salary $130K – $140K USD / year
Type Not Specified
Experience mid
Exp. Years Not specified
Education Not specified
Category AI & Machine Learning

Circle's Applied AI team is seeking an AI Platform Engineer to develop infrastructure for measuring and improving AI system performance, focusing on large language models and AI workflows.

  • Build evaluation infrastructure
  • Create observability tooling and dashboards
  • Diagnose quality gaps
  • Experiment with models and configurations
  • Prototype improvements to RAG pipeline

The role involves building evaluation frameworks, observability dashboards, and diagnostic tools for AI systems, primarily using Python and data pipelines.

The ideal candidate is a mid-level AI engineer with experience in large language models, AI system evaluation, and observability tooling. They should be comfortable building infrastructure to measure and improve AI systems at scale.

Building evaluation infrastructureAI system measurementObservability toolingPrototyping solutionsData validation
Large language modelsAI workflowsAI copilotModel diagnosticsML infrastructure
PythonData pipelinesDashboard tools
Large Language Modelsevaluation infrastructureobservability toolingdiagnostic infrastructureprototypingdata validationAI systemsRAG pipelineretrievalre-rankingchunking strategies
Large Language ModelsLLMsAI systemsEvaluation frameworksObservability toolingDiagnostic infrastructurePrototypingModel evaluationRetrieval-Augmented GenerationRAG pipelineChunking strategiesRetrieval methodsRe-ranking approaches
Problem-solvingCollaborationData-driven decision makingOwnershipInnovation
Industry SaaS
Job Function Developing AI system measurement and diagnostics infrastructure
Role Subtype AI Platform Engineer
Tech Domains Python
AI Platform EngineerLarge Language ModelsLLMsevaluation infrastructureobservability toolingdiagnostic infrastructuremodel evaluationprototypingAI systemsdata-drivenRAG pipelineretrievalre-rankingchunking strategiesAI workflowsAI copilotAI platform engineerlarge language modelsdata validationrag pipeline

Lack of experience with AI evaluation frameworks, No experience with AI system diagnostics, No familiarity with large language models

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile