Sr Data Engineer

About Shipium

Shipium is on a mission to solve the ‘Prime problem’ that modern retailers face today how to make fast, free, and on-time delivery promises a cornerstone of the customer’s shopping experience. We work with both fast-growing companies and well-known large retailers to cut costs, speed deliveries, and increase flexibility through great APIs, easy integrations into existing infrastructure, and powerful services optimizing the full retail supply chain.

We’re building tech that connects previously fragmented systems and automates complex supply chain decisions to deliver speed and value across operations. 

Founded in 2019 by supply chain technology experts from Amazon and Zulily, the company is on a mission to help every eCommerce company provide its customers a great delivery experience while simultaneously reducing their costs to fulfill orders.

About the role

Are you interested in building the next-generation services that will solve complex business problems in the e-commerce fulfillment and supply chain industry? We are disrupting the space to provide easy access, fast, and economical shipping and delivery experiences for companies of all sizes.

Shipium is looking for a talented Senior Data Engineer to design and build a new product from the ground up. We are seeking strong experience with data transformation on diverse datasets, leveraging cloud-based data lakes (AWS S3) and modern warehousing solutions like Redshift. Expertise with orchestration tools like Airflow and open technologies such as DBT, Python, DLT, and DuckDB is crucial.

You'll need to demonstrate the ability to rapidly understand and master complex domain data models, adapting quickly to the unique challenges of the fulfillment and supply chain space.

You will be responsible for designing and implementing scalable extract, transform, and load (ETL) processes to support rapidly growing and dynamic business needs requiring high-quality data. This includes monitoring, maintaining, and troubleshooting these processes in production environments to ensure data reliability and availability.

You will be driving the construction of a cutting-edge data platform in an exciting new space. Along the way, we guarantee that you’ll learn a ton, have fun, and make a significant impact.

What you'll do

• Design and implement scalable extract, transform, and load (ETL) processes to support rapidly growing and dynamic business needs that demand high-quality data.
• Take full ownership of the technical architecture, design, and implementation of our data platform and related tools, including our data lake and warehousing solutions.
• Collaborate with stakeholders and other engineering leaders to define and develop our data platform roadmap.
• Act as a subject matter expert, providing technical guidance to leadership on solution design and best practices.
• Drive team planning across multiple initiatives, playing a key role in prioritization processes by identifying and communicating critical tradeoffs to maximize team effectiveness and deliver measurable business value.
• Mentor and train incoming and junior data engineers; participate in the hiring process.

Qualifications

• 6+ years of strong experience in data engineering, with a focus on:
• • Designing, building, and optimizing data pipelines using Airflow.
  • Working extensively with cloud-based data warehousing solutions, particularly Amazon Redshift.
  • Building and managing data lakes on AWS S3.
• 6+ years of experience writing complex SQL queries, with strong knowledge of SQL optimization and an understanding of logical and physical execution plans, especially within a Redshift environment.
• Proven experience with data transformation on large datasets using open technologies like Python, DLT, SQL, DuckDB, DBT, pandas, and Jupyter Notebook.
• Advanced knowledge of Modern Data Warehouse concepts & Big Data Modeling (e.g., Relational, Dimensional, logs at scale).
• Strong knowledge of Python and UNIX Shell Scripting.
• Proven experience working with var