About this role
SDE for AWS Neuron Runtime focusing on delivering high-performance runtimes for AI workloads on Inferentia. Designs, develops, and deploys distributed machine learning runtime software and Linux drivers, collaborating with ML teams to optimize performance and scale.
Key Responsibilities
- Design, develop, and deploy runtime software for AWS Neuron on Inferentia
- Develop high-performance Linux drivers and HPC libraries (libfabric, MPI)
- Collaborate with ML scientists to optimize performance
- Mentor and review code; uphold coding standards and testing
- Deliver scalable, fault-tolerant runtime systems for customers
Technical Overview
Proficient with Linux drivers and HPC libraries (libfabric, MPI), and ML frameworks (TensorFlow, PyTorch, MXNet) in C/C++/Python; builds distributed, multi-threaded runtimes for AI accelerators; works with AWS infrastructure and ML researchers to optimize performance.
Ideal Candidate
The ideal candidate is a mid-level software engineer with 3+ years of professional software development experience, strong OO design skills, and hands-on experience with distributed systems and AWS. They should be comfortable in a fast-paced environment and capable of mentoring others while shaping architecture and product direction for GenAI services.
Must-Have Skills
3+ years of non-internship professional software development experience2+ years of non-internship design or architecture (design patternsreliability and scaling) of new and existing systems1+ years of software development engineer or related occupational experience1+ years of designing and developing large-scalemulti-tieredmulti-threadedembedded or distributed software applicationstoolssystemsand services using: C#C++Javaor Perl1+ years of Object Oriented Design experienceBachelor's degree or foreign equivalent in Computer ScienceEngineeringMathematicsor a related fieldExperience programming with at least one software programming language
Nice-to-Have Skills
3+ years of full software development life cycleincluding coding standardscode reviewssource control managementbuild processestestingand operations experienceBachelor's degree in computer science or equivalent
Required Skills
3+ years of non-internship software development experience2+ years design or architecture (design patternsreliability and scaling) of new and existing systems1+ years of software development engineer or related occupational experience1+ years of OO designC#C++JavaPerlObject Oriented DesignDesign PatternsArchitectureSoftware Development Life CycleCode ReviewsSource Control ManagementBuild ProcessesTestingAmazon Web ServicesAWSTensorFlowPyTorchMXNetLinuxDistributed softwareMulti-threaded
Hard Skills
C# (C-Sharp)C++ (C Plus Plus)JavaPerlObject Oriented DesignDesign PatternsArchitectureSoftware Development Life CycleCode ReviewsSource Control ManagementBuild ProcessesTestingAWSAmazon Web ServicesDistributed systemsMulti-threaded
Soft Skills
communicationleadershipmentoring engineerscollaborationproblem solvingteamworkadaptability
Keywords for Your Resume
Software Development EngineerAgentic AIAgentCore MemoryGenAIdistributed machine learning systemslarge-scale software systemsC# (C-Sharp)C++ (C Plus Plus)JavaPerlObject Oriented DesignDesign PatternsArchitectureSoftware Development Life CycleCode ReviewsSource Control ManagementBuild ProcessesTestingAmazon Web ServicesAWSTensorFlowPyTorchMXNetLinuxDistributed softwareMulti-threaded
Deal Breakers
Less than 3 years of non-internship software development experience, No experience with distributed systems or AWS, No exposure to ML frameworks
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile