About this role
Software Engineer role focusing on AWS-based data pipelines and analytics with Spark, Snowflake/Redshift, and data modeling.
Key Responsibilities
- Design and develop data pipelines
- Implement data models and warehousing solutions
- Manage APIs and data integrations
- Apply CI/CD and Agile practices
Technical Overview
Data engineering stack on AWS with Java/Spark, PySpark, SQL; data formats JSON/AVRO/Protobuf; Parquet/Iceberg; Warehousing in Snowflake/Redshift
Ideal Candidate
The ideal candidate is a software engineer with 2+ years of experience (though the posting states 2 years) focusing on cloud-based data engineering tasks using AWS, Java, and PySpark, with strong SQL and data modeling capabilities.
Must-Have Skills
Extensive experience in AWSdesignimplementationand maintenance of data pipelines using Java-Spark and PySparkProficient in SQLExperience with SnowflakeAWS RedshiftData structuresData serialization formats such as JSONAVROProtobufParquetIcebergData processing methodologies (batchmicro-batchingstreaming)Data modeling techniques (DimensionalData VaultKimballInmon)CI/CDAgile methodologies
Nice-to-Have Skills
NoSQL databasesFintech/wealth tech experienceObservability tooling
Tools & Platforms
Amazon Web ServicesJavaPythonPySparkSQLJSONAVROProtobufParquetIcebergSnowflakeAmazon Redshift
Required Skills
AWS; Java; PySpark; SQL; JSON; AVRO; Protobuf; Parquet; Iceberg; Snowflake; Amazon Redshift; APIs; Data pipelines; Data modeling; Dimensional modeling; Data Vault; Kimball; Inmon; CI/CD
Hard Skills
Amazon Web ServicesJavaPythonPySparkSQLJSONAVROProtobufParquetIcebergSnowflakeAmazon RedshiftAPIsData pipelinesData modelingDimensional modelingData VaultKimballInmonCI/CD
Soft Skills
collaborationteamworkcommunicationproblem solvingownership
Keywords for Your Resume
software engineerawsamazon web servicespysparkjavasqlsnowflakeamazon redshiftparqueticebergprotobufavrojsondata pipelinesdata modelingdimensional modelingdata vaultkimballinmonci/cdcloud data warehouseremotefintechpython
Deal Breakers
Not specified
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile