Jobs and Careers

Lead Data Engineer

United Statesfull_timeVerifiedPosted 6 Jun 2024

About the role

About the roleTotal Wine & More is seeking a Lead Data Engineer with expertise in all aspects of data engineering, data management, and data analysis, to join our Data Services team in Bethesda, MD. We are embarking on a significant initiative to transform all aspects of data management services within Total Wine & More including enterprise data architecture, business intelligence, and data warehousing – leveraging the cloud to apply advanced analytics and data mining capabilities longer term. We are looking for an individual with experience in and who is passionate about data, data architecture, and data engineering to help execute the vision for data services at Total Wine & More. You will leverage advanced data engineering, cloud architecture, and programming skills to drive business value across all departments. You will work closely with the business, software development and support teams, infrastructure, and security staff and will enjoy learning and problem-solving in a fast-paced environment. You will report to the Senior Manager of Data Engineering. You will

In partnership with the Data Services leadership team, develop the vision for the next evolution of our Enterprise Data & Analytics Platform
Partner with Data Services product owners, data warehouse engineers, data scientists, and BI developers to support and deliver best-in-class reports, predictive models, datasets, and solutions.
Create and manage batch and real time data pipelines.
Manage and enhance our Kafka and Kubernetes implementations.
Stay informed of new technologies and trends to guide the optimization of and continuous advancement of our platforms.
Conduct exploratory data analysis to understand the patterns and potential business insights exhibited in the data.
Be proactive and take ownership of the projects and tasks assigned.
Coach junior team members and share knowledge with the broader team.
Engage in implementing good security practices to handle sensitive information.

You will come with

Bachelor's degree from four-year College or university in Computer Science, Technology, Business, or related field. Master’s or PhD preferred.
5+ years of experience in data engineering, data architecture, data warehousing or related fields.
Proven track record in building impactful platforms and solutions using cloud-native tools.
Experience using ETL/ELT tools – Airflow, Data Fusion, Dataprep, Informatica, Fivetran.
Experience using Apache Kafka or Confluent Kafka or Google Pub/Sub.
Experienced with general programing languages, such as Python, SQL, and SQL-like query languages for NoSQL databases.
Experience using MapReduce or distributed computing technologies like PySpark, Apache Beam.
Experience in leveraging the cloud in the development of data & analytics platforms.
Familiarity with Dev-ops, Kubernetes, Docker.
Experience with CI/CD including GitHub, Cloud Build, Jenkins.
Passionate about data, data engineering, and platform development.
Strong analytic skills, attention to detail, ability to multi-task, troubleshoot and problem solve along with the ability to make recommendations based on analysis are extremely important.
Must possess excellent verbal, written, and presentation communication skills.
Experience with cloud-based analytical platforms (GCP, Azure) is preferred.
Experience with workflow management (Airflow) and data warehouse tools (dbt) is preferred.
Knowledge of data lifecycle management (DLM) is preferred.
Familiar with retail operations is preferred.