Position Details

Type Full-Time

Experience mid

Exp. Years 3+ years

Education Not specified

Category Data & Analytics

About this role

A mid-level data engineer role focused on designing and maintaining scalable data pipelines and streaming systems to support analytics and BI initiatives.

Key Responsibilities

Design and build data pipelines
Maintain streaming systems
Develop data transformation processes
Collaborate with BI teams
Ensure data quality and lineage

Technical Overview

Environment includes Apache Kafka, Spark, Python, MongoDB, SQL Server, Power BI, and modern data platform tools, emphasizing data ingestion, transformation, and modeling.

Ideal Candidate

The ideal candidate is a mid-level data engineer with expertise in building scalable data pipelines, streaming systems, and data transformation processes, with experience in modern data platforms and tools like Kafka, Spark, and Power BI.

Must-Have Skills

Building data pipelinesStreaming systemsData transformationData ingestionData modelingSQLPython

Nice-to-Have Skills

FivetranDBTAWS LambdaSnowflakeAICopilot

Tools & Platforms

Apache KafkaApache SparkMongoDBSQL ServerMicrosoft FabricPower BICopilotPurviewFivetranDBTAWS Lambda

Required Skills

Building data pipelinesStreaming systemsData transformationData ingestionData modelingSQLPython

Hard Skills

Apache KafkaApache SparkPythonMongoDBSQL ServerData FramesRapidsMicrosoft FabricPower BICopilotPurviewData PipelinesETLELTData ModelingData LineageMetadata ManagementMonitoringOptimization

Soft Skills

CollaborationCommunicationProblem-solvingAttention to detailTeamwork

Industry & Role

Industry Information Technology

Job Function Build and maintain data infrastructure for analytics

Role Subtype Data & Analytics

Tech Domains Apache Kafka, Apache Spark, Python, MongoDB, SQL Server, Power BI, Microsoft Fabric, AWS Lambda

Clearance & Visa

Clearance Required None

Visa Sponsorship No

Keywords for Your Resume

Data EngineerStreaming DataData PipelinesApache KafkaApache SparkPythonMongoDBSQL ServerData TransformationETLELTData ModelingData LineagePower BIMicrosoft FabricCopilotFivetranDBTAWS LambdaStreaming dataData pipelinesSQLData modeling

Deal Breakers

Lack of experience with data pipelines, No knowledge of Kafka or Spark, Inability to work onsite in Florida

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Data Engineer (Streaming & Analytics)

Get matched to jobs like this