Position Details

Salary $141K – $232K USD / year

Type Not Specified

Experience senior

Exp. Years Not specified

Education Not specified

Category Data & Analytics

About this role

As a Senior Software Engineer focused on Python and the Data Ecosystem, you will own critical parts of ClickHouse’s data engineering integrations. The role connects ClickHouse to the tools data teams already use, from analytics and visualization to orchestration platforms and AI workflows.

Key Responsibilities

Own and evolve Python integrations for the data ecosystem
Drive architecture, performance, and feature direction
Build tooling that enables Data Engineers and Data Scientists to use ClickHouse
Integrate across orchestration platforms (Apache Airflow, Dagster, Prefect)
Collaborate with open-source community and enterprise users to ensure reliability and developer experience

Technical Overview

You will build and evolve Python integrations that emphasize architecture, performance, and reliability while improving developer experience. The stack and ecosystem includes orchestration platforms (Apache Airflow, Dagster, Prefect) and integration targets like Tableau, PowerBI, Superset, Metabase, Apache Spark, Flink, Kafka Connect, and Fivetran, with strong alignment to AI data patterns such as RAG pipelines and vector stores.

Ideal Candidate

The ideal candidate is a senior engineer who has operated directly in Data Engineer or Data Scientist workflows and can build Python integrations for a high-performance data ecosystem. They have experience with orchestration platforms like Apache Airflow, Dagster, and Prefect, and they understand modern AI data patterns such as RAG pipelines, vector stores, and real-time feature stores. They will own integration architecture with a strong focus on performance, reliability, and developer experience.

Must-Have Skills

Python integrationsOrchestration Platforms: Apache AirflowApache AirflowDagsterPrefectdata engineering ecosystem ownershiparchitectureperformancereliabilitydeveloper experiencelived Data Engineer or Data Scientist experience firsthand

Nice-to-Have Skills

AI-powered data applicationsRAG pipelinesLLM-powered agentsvector storesreal-time feature storesML inferenceApache SparkFlinkKafka ConnectFivetranTableauPowerBISupersetMetabase

Tools & Platforms

ClickHouseTableauPowerBISupersetMetabaseApache SparkApache FlinkKafka ConnectFivetranApache AirflowDagsterPrefect

Required Skills

PythonApache AirflowDagsterPrefectTableauPowerBISupersetMetabaseApache SparkFlinkKafka ConnectFivetranreal-time analyticsdata warehousingobservabilityAI workloadsvector storesRAG pipelinesLLM-powered agentsreal-time feature storesML inference

Hard Skills

PythonOrchestration Platforms: Apache AirflowApache AirflowDagsterPrefectTableauPowerBISupersetMetabaseApache SparkFlinkKafka ConnectFivetranreal-time analyticsdata warehousingobservabilityAI workloadsdata engineeringvector storesRAG pipelinesLLM-powered agentsreal-time feature storesML inferenceintegrationsarchitectureperformancereliabilitydeveloper experiencehigh-performance database engineering

Soft Skills

own and evolve critical parts of the data engineering ecosystemcollaborate closely with the open-source communityinternal teamsand enterprise usersproduct-level insight into what to build and whycommunication and developer experience focus

Industry & Role

Industry SaaS

Job Function Develop and maintain Python integrations that embed ClickHouse into modern data engineering and AI workflows

Role Subtype Data Engineer

Tech Domains Python, Linux, Kubernetes, Kafka, Docker, Amazon Web Services, Azure, Tableau, SQL / PostgreSQL

Keywords for Your Resume

Senior Software EngineerSenior Software Engineer - Python and Data EcosystemClickHousePythondata engineering ecosystemdata integrationsorchestration platformsApache AirflowDagsterPrefectreal-time analyticsdata warehousingobservabilityAI workloadsvector storesRAG pipelinesLLM-powered agentsreal-time feature storesML inferenceperformancereliabilitydeveloper experienceTableauPowerBIApache SparkKafka ConnectFivetran

Deal Breakers

Demonstrated ability to own Python integrations end-to-end (architecture, performance, feature direction), Experience with orchestration platforms such as Apache Airflow, Dagster, or Prefect, Hands-on experience in Data Engineer or Data Scientist workflows

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile