About this role

A senior software engineer role focused on designing and developing scalable data pipelines and cloud-based data processing systems using modern big data and container orchestration technologies.

Key Responsibilities

Design and develop scalable data pipelines
Implement cloud-based data processing solutions
Optimize stream processing systems
Troubleshoot and improve data infrastructure
Collaborate with DevOps and QA teams

Technical Overview

Involves building data and analytics pipelines with Dataflow, Pub/Sub, GKE, and Kubernetes, emphasizing scalability, security, and real-time stream processing in cloud environments.

Ideal Candidate

The ideal candidate is a senior software engineer with over 10 years of experience in building scalable data pipelines, cloud services, and stream processing systems. They are proficient with Kubernetes, GKE, and big data technologies, and excel in troubleshooting and optimizing cloud-based data solutions.

Must-Have Skills

Developing services in the cloudBuilding data pipelinesExperience with KubernetesStream processingScalable big data stores

Nice-to-Have Skills

Customer troubleshootingDevOpsQuality assurance

Tools & Platforms

GKEKubernetesGradleMavenDataflowPub/Sub

Required Skills

Big DataData pipelinesAnalytics pipelinesDataflowPub/SubGKEKubernetesRESTful interfacesBuild Management toolsGradleMavenContinuous integrationCloud technologiesSecurity protocolsScalabilityMessage queuingStream processing

Hard Skills

Big DataData pipelinesAnalytics pipelinesDataflowPub/SubGKEKubernetesRESTful interfacesBuild Management toolsGradleMavenContinuous integrationCloud technologiesSecurity protocolsScalabilityMessage queuingStream processing

Soft Skills

CommunicationTeamworkProblem-solvingCollaborationAdaptability

Industry & Role

Industry Technology

Job Function Develop scalable big data and cloud data pipelines

Keywords for Your Resume

Big DataData pipelinesAnalytics pipelinesDataflowPub/SubGKEKubernetesRESTful interfacesBuild Management toolsGradleMavenContinuous integrationCloud technologiesSecurity protocolsScalabilityMessage queuingStream processingCloud securityData engineering

Deal Breakers

Lack of experience with Kubernetes or GKE, No background in cloud data services, Inability to work in a collaborative team environment

Principal Engineer Software (Backend Engineer- Prisma Access Browser)

Get matched to jobs like this