Position Details

Type Not Specified

Experience mid

Exp. Years Not specified

Education Not specified

Category AI & Machine Learning

About this role

This role focuses on developing and optimizing tokenization and encoding systems for AI research, supporting efficient and reliable model training workflows.

Key Responsibilities

Design tokenization systems
Optimize encoding techniques
Collaborate with research teams
Build data pipelines
Implement monitoring and debugging

Technical Overview

The position involves software engineering, ML infrastructure, tokenization algorithms, data pipelines, and multi-language support, primarily using Python.

Ideal Candidate

The ideal candidate is a mid-level machine learning systems engineer with experience in developing tokenization and encoding systems, proficient in Python, and capable of working independently in research-focused environments.

Must-Have Skills

software engineering experiencemachine learning expertisePython proficiencyexperience with ML data pipelinesbuilding or optimizing data encodings

Nice-to-Have Skills

working with ML data processing pipelinestokenization algorithmsperformance optimizationmulti-language tokenizationresearch environment experience

Tools & Platforms

PythonML pipelinesTokenization algorithmsData processing systems

Required Skills

Machine LearningResearch ToolsTokenizationData PipelinesML InfrastructureModel trainingEncoding techniquesBPEWordPieceData representationMonitoringDebuggingTesting frameworksMulti-language tokenizationPython

Hard Skills

Soft Skills

collaborationproblem-solvingindependent workanalytical skillsimpact-drivenflexibilitycommunication

Industry & Role

Industry Technology / AI & Machine Learning / Research

Job Function ML research infrastructure and systems engineering

Keywords for Your Resume

Machine Learning Systems EngineerResearch ToolsTokenizationData PipelinesML InfrastructureModel trainingEncoding techniquesBPEWordPieceData representationMonitoringDebuggingTesting frameworksMulti-language tokenizationPythonMachine Learning

Deal Breakers

Lack of machine learning expertise, No experience with ML data pipelines, Inability to work independently, No proficiency in Python

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Machine Learning Systems Engineer, Research Tools

Get matched to jobs like this