Senior Data Engineer (HYBRID REMOTE)

<h2></h2> <p> </p> <p><span>About us</span></p> <p>At Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfill the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We make it possible for businesses to meet the ever rising expectations of their customers, and we make the world smaller and more accessible to consumers everywhere. Auctane brands enable hundreds of thousands of merchants to annually deliver billions of products — over $200 billion worth — to customers around the globe. And Auctane is just getting started.</p> <p>Auctane is a team of shipping and software experts with a passion for helping merchants move their ideas, dreams and innovations around the globe. The Auctane family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, GlobalPost, and Packlink. Our partners include Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.</p> <p><span>Our values</span></p> <p></p> <p><span>About the role</span></p> <p>This is a hands-on role for an Senior Data Engineer sitting within the Data Products team. In this role, you will have an enormous impact on the design, implementation, and maintenance of existing and greenfield customer-facing data products. Data is key to Auctane’s strategy. We work at a scale pace and with the latest architecture patterns and tech. We process thousands of events per second, and our massive dataset keeps growing at a staggering pace. We keep improving our data platform and data engineering stack to accommodate growth, enable novel solutions, and provide the best service to our customers. We have a flat and open engineering culture where data &amp; evidence beat opinion and hierarchy, backed by honest discussions. We passionately believe in forming autonomous, cross-functional teams who are empowered to deliver our ambitious strategy. Energy and passion for our business and customers are a part of the Auctane culture – and we love working with like-minded people.</p> <p> </p> <p><span>What will you be doing?</span></p> <ul> <li>Contribute to the design, build, and operational management of our data pipelines and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, and Kinesis.</li> <li>Collaborate with the Product Owner and other stakeholders to implement the Data Products strategy.</li> <li>Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset.</li> <li>Drive the design and architecture of Auctane’s data product.</li> <li>Contribute directly to the implementation and operations of our systems.</li> <li>Be an advocate of data quality and observability principles and use state-of-the-art technologies like Airflow, dbt, and Spark to process data and get our datasets just right.</li> <li>Foster engineering excellence by delivering highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc.</li> </ul> <p><span>What are we looking for?</span></p> <ul> <li>A strong Data Engineering background in a data warehouse or data lake architecture</li> <li>Experience working in AWS/GCP cloud infrastructure.</li> <li>Experience developing and supporting robust, automated, and reliable data pipelines in Python and SQL.</li> <li>Mastered Python and SQL skills.</li> <li>Experience with data processing frameworks like Spark, Athena, or Pandas.</li> <li>Knowledge of Data Orchestration solutions, preferably Airflow.</li> <li>Knowledge of relational database design as well as Snowflake/Redshift or similar</li> </ul> <p><span>What will make you stand out?</span></p> <ul> <li>Production experience working with very large datasets.</li> <li>Experience with AWS and big data cloud technologies like EMR, Athena, Glue, and EC2.</li> <li>Direct experience with Infrastructure as Code tools (e.g., Terraform, CloudFormation)</li> <li>Knowledge and direct experience in using business intelligence and analytics tools (Tableau, Looker, Power BI, etc.)</li> <li>A desire to constantly challenge the norm Proven track record of promoting and maintaining high engineering standards.</li> <li>Fast learner with a keen interest in evaluating and adopting new technologies: Apache Iceberg, Dagster, DBT, GreatExpectations, Prefect, Snowflake, etc.</li> <li>Understanding of core ML concepts like supervised and unsupervised learning, overfitting, and cross-validation as well as LLM concepts like fine-tuning, etc.</li> </ul> <p> </p> <p><span>Tech Stack</span></p> <ul> <li>Python</li> <li>SQL</li> <li>Amazon Web Services</li> <li>C# .NET</li> </ul> <p> </p> <p><span>What do we offer?</span></p> <p> </p> <p><strong>🗓️ Annual Salary Review: </strong>We are reviewing the salaries of all our teams annually in order to evaluate an increase according to individu