Position Details

Salary $62K – $141K USD / year

Type Not Specified

Experience mid

Exp. Years 3+ years

Education Bachelor's degree in Computer Science or Data Engineering

Category Data & Analytics

About this role

This role involves managing large-scale data ecosystems, focusing on storage strategies, metadata management, and cloud integration to support data discoverability and governance.

Key Responsibilities

Managing data ecosystems
Implementing storage and metadata strategies
Optimizing data lifecycle workflows
Ensuring data discoverability
Collaborating with cross-functional teams

Technical Overview

The technical environment includes cloud storage platforms like AWS S3, Azure, and GCP, with tools such as Open Metadata, and scripting in Python for data workflows and lifecycle management.

Ideal Candidate

The ideal candidate is a data management engineer with at least 3 years of experience managing large-scale data ecosystems, proficient in metadata tools like Open Metadata, and experienced with cloud storage solutions such as AWS S3, Azure, or GCP. They should have strong analytical skills and knowledge of data lifecycle strategies.

Must-Have Skills

3+ years of experience managing large-scale data ecosystemsExperience with metadata management tools such as Open MetadataExperience integrating storage and metadata strategies into Agile teamsKnowledge of data lifecycle management strategiesKnowledge of cloud-based storage systems and intelligent tieringAbility to work with large datasets using PythonAbility to obtain and maintain a Public Trust or Suitability/Fitness determination

Nice-to-Have Skills

Experience configuring cloud-native tools for policies on intelligent tieringExperience working with AWS S3 Intelligent-TieringAzureor GCPExperience with data observability tools

Tools & Platforms

AWS S3AzureGCPOpen MetadataLambdaStep Functions

Required Skills

metadata managementstorage strategiescloud storageAWS S3AzureGCPAPIsdata lifecycle managementPython

Hard Skills

metadata managementOpen Metadatastorage strategiescloud storageAWS S3AzureGCPAPIsdata lifecycle managementtieringretention policiesarchival workflowsPythonprogramming

Soft Skills

analytical skillsproblem-solvingcollaborativeteamwork

Certifications

Required

Public TrustSuitability/Fitness

Industry & Role

Industry Government/Public Sector

Job Function Data management and storage strategy implementation for large-scale data ecosystems

Keywords for Your Resume

Data Management Engineermetadata managementOpen Metadatastorage strategiescloud storageAWS S3AzureGCPAPIsdata lifecycle managementtieringretention policiesarchival workflowsPythonprogramming

Deal Breakers

Lack of experience with metadata management tools, No experience with cloud storage systems, Inability to obtain Public Trust clearance, Less than 3 years of relevant experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile