Position Details

Type Not Specified

Experience senior

Exp. Years 5+ years

Education Not specified

Category Software Engineering

About this role

This role involves designing and implementing real-time, scalable data movement platforms using Apache NiFi, focusing on high-performance distributed systems.

Key Responsibilities

Design distributed data pipelines
Implement control and data plane features
Ensure system scalability and reliability
Optimize data throughput and latency
Mentor junior engineers

Technical Overview

The technical environment includes distributed system architecture, control and data planes, Apache NiFi, cloud platforms, and performance optimization techniques.

Ideal Candidate

The ideal candidate is a senior software engineer with extensive experience in building scalable, real-time data integration systems using Apache NiFi and distributed architectures. They excel in designing reliable data pipelines, optimizing performance, and mentoring junior engineers.

Must-Have Skills

Distributed systemsControl planeData planeReal-time data processingApache NiFiScalable system designSoftware engineering best practicesMonitoring and incident responsePerformance optimizationTeam mentorship

Nice-to-Have Skills

Cloud platformsStreaming data pipelinesData integration toolsOpen-source contributionsPerformance profiling

Tools & Platforms

Apache NiFiCloud platforms (AWSAzureGCP)Monitoring toolsData pipelines

Required Skills

Distributed systemsControl planeData planeReal-time data movementApache NiFiScalable systemsStreaming workloadsBatch processingMonitoringIncident response

Hard Skills

Distributed systemsControl planeData planeReal-time data movementApache NiFiScalable systemsStreaming workloadsBatch processingHigh-throughputLow-latencyCloud-native platformsData integrationSoftware developmentSystem designMonitoringIncident responsePerformance optimizationReliability engineeringMentoring

Soft Skills

CollaborationCommunicationProblem-solvingTeamworkTechnical leadershipAdaptability

Industry & Role

Industry Technology / Data & Analytics

Job Function Develop scalable, real-time data integration systems

Keywords for Your Resume

Distributed systemsControl planeData planeReal-time data movementApache NiFiScalable systemsStreaming workloadsBatch processingHigh-throughputLow-latencyCloud-native platformsData integrationMonitoringIncident responsePerformance optimizationReliability engineeringMentoringSystem designReal-time dataData pipelineCloud platforms

Deal Breakers

Less than 5 years experience in distributed systems, Lack of experience with Apache NiFi, No background in real-time data processing, Inability to work in Menlo Park location

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Software Engineer - Openflow

Get matched to jobs like this