Position Details

Type Full-Time

Experience senior

Exp. Years 8+ years

Education Bachelor’s or Master’s degree in Computer Science or equivalent experience.

Category QA & Testing

About this role

Senior Software Engineer in Test for Cloudera's Anywhere Cloud team, focusing on validating end-to-end data pipelines across Kubernetes-based deployments and AI-enabled test automation capabilities.

Key Responsibilities

End-to-end data pipeline validation
Kubernetes-based test automation
Data governance and ABAC validation
Collaboration on AI-enabled testing frameworks
Mentorship and technical leadership

Technical Overview

Expertise in Python/Shell, Kubernetes, Spark, Kafka, Trino, Airflow; tooling includes Octopai, Apache Polaris, Helm; emphasis on data governance, ABAC, and automated validation of complex data pipelines.

Ideal Candidate

The ideal candidate is a senior SDET with deep experience in end-to-end data pipeline validation, Kubernetes-based test automation, and a strong data governance mindset. They should be proficient in Python/Shell with Spark/Kafka/Trino, and able to lead cross-team QA efforts in a data-centric SaaS environment.

Must-Have Skills

8+ years of software engineering experience with a focus on test automationinfrastructureor backend developmentExpert-level proficiency in Python/ShellKubernetes expertiseSparkKafkaTrinoAirflow for automationExperience with Kubernetes-based test automationStrong scripting and automation capabilitiesBachelor's or Master's degree in Computer Science or related field

Nice-to-Have Skills

Experience with AI-enabled test automationFamiliarity with governance tools like OctopaiZero-downtime upgrades testing for stateful data engines

Tools & Platforms

KubernetesApache SparkKafkaTrinoAirflowOctopaiApache PolarisHelmABACCRDControllersOperatorsSQL

Required Skills

8+ years of software engineering experience with a focus on test automationPythonShellKubernetesApache SparkKafkaTrinoAirflowOctopaiApache PolarisHelmABACData governanceData quality checksStatistical anomaly detectionEnd-to-end data pipeline validationCRDControllersOperatorsSQLCI/CD

Hard Skills

PythonShellKubernetesApache SparkKafkaTrinoAirflowOctopaiApache PolarisHelmABACData governanceData quality checksStatistical anomaly detectionEnd-to-end data pipeline validationCRDControllersOperatorsSQLCI/CD

Soft Skills

LeadershipMentoringCross-team collaborationCommunicationProblem-solving

Industry & Role

Industry SaaS

Job Function Lead testing and validation of large-scale data pipelines and AI-enabled data infrastructure

Role Subtype QA & Testing

Tech Domains Python, Shell, Kubernetes, Apache Spark, Kafka, Trino, Airflow, Helm, SQL

Keywords for Your Resume

Senior Software Engineer in TestAnywhere CloudkubernetesKubernetesApache SparkSparkKafkakafkaTrinoAirflowPythonShellOctopaiApache PolarisHelmABACData governanceData quality checksStatistical anomaly detectionEnd-to-end data pipeline validationCRDControllersOperatorsCI/CDSQL

Deal Breakers

8+ years of testing/automation in data pipelines, Kubernetes and Spark/Kafka experience, Strong Python/Shell scripting, Experience with end-to-end data pipeline validation

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Software Engineer in Test - Anywhere Cloud

Get matched to jobs like this