✦ Luna Orbit — Software Engineering

Senior Software Engineer - NIM Factory Container and Cloud Infrastructure

at Nvidia

📍 4 Locations Unknown Posted March 18, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Not Specified
Experience senior
Exp. Years Not specified
Education BS or MS in Computer Science, Computer Engineering, or related field
Category Software Engineering

About this role

This role involves designing and optimizing container and cloud infrastructure for NVIDIA's inference microservices, focusing on GPU workloads, multi-architecture builds, and scalable deployment strategies.

Key Responsibilities

  • Design and implement container strategies
  • Optimize container performance
  • Manage multi-arch builds
  • Deploy GPU workloads in Kubernetes
  • Collaborate with research and backend teams

Technical Overview

The technical environment includes Docker, Kubernetes, Helm, CUDA, and NVIDIA device plugins, aimed at building high-performance, scalable containerized AI inference systems.

Ideal Candidate

The ideal candidate is a senior software engineer with expertise in containerization, cloud infrastructure, and GPU workloads, proficient in Python and Kubernetes, with experience in performance tuning and multi-cluster deployments.

Must-Have Skills

ContainersCloud InfrastructurePythonKubernetesDockerGPU workloadsBuild orchestrationPerformance optimization

Nice-to-Have Skills

HelmOperatorCI/CDCUDAMulti-arch buildsMulti-cluster deploymentNVIDIA device pluginContainer performance tuning

Tools & Platforms

DockerKubernetesHelmOperatorCUDANVIDIA device plugin

Required Skills

ContainersCloud InfrastructureNVIDIA Inference MicroservicesPythonKubernetesDockerHelmOperatorCI/CDCUDAGPU workloads

Hard Skills

ContainersCloud InfrastructureNVIDIA Inference MicroservicesPythonKubernetesDockerHelmOperatorCI/CDCUDAGPU workloadsMulti-arch buildsBuild orchestrationContainer buildPackagingDeploymentPerformance optimizationMetricsTracingMulti-cluster rolloutsNVIDIA device plugin

Soft Skills

CollaborationCommunicationMentoringHigh engineering standardsProblem-solving

Industry & Role

Industry Technology
Job Function Developing container and cloud infrastructure for AI inference microservices
Role Subtype Software Engineering
Tech Domains Containers, Kubernetes, Docker, Python, GPU, Cloud Infrastructure

Keywords for Your Resume

containerscloud infrastructureNVIDIA inference microservicesPythonKubernetesDockerHelmCI/CDCUDAGPU workloadsmulti-arch buildsbuild orchestrationcontainer buildpackagingdeploymentperformance optimizationmetricstracingmulti-clusterNVIDIA device plugin

Deal Breakers

Lack of experience with containers or Kubernetes, No GPU workload experience, Insufficient Python skills, No background in container performance tuning, Lack of collaboration skills

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile