Staff Data Engineer - Lead

About DAT

DAT is an award-winning employer of choice and a next-generation SaaS technology company that has been at the leading edge of innovation in transportation supply chain logistics for 45 years. We continue to transform the industry year over year, by deploying a suite of software solutions to millions of customers every day - customers who depend on DAT for the most relevant data and most accurate insights to help them make smarter business decisions and run their companies more profitably. We operate the largest marketplace of its kind in North America, with 400 million freights posted in 2022, and a database of $150 billion of annual global shipment market transaction data.  Our headquarters are in Denver, CO, and Beaverton, OR, with additional offices in Missouri, and Bangalore, India. For additional information, see www.DAT.com/company.

 

Job Application Deadline: 12/31/2024

 

The Opportunity

DAT is looking for a Staff Data Engineer, Lead to join our Data Engineer team working hybrid in Denver, Colorado or Beaverton, Oregon; or remotely if based in Seattle, Washington.

Candidate profile

As a Staff Data Engineer - Lead, you will be responsible for developing data engineering patterns and practices within the organization and in the team. You will support us in designing, building, and maintaining our data infrastructure, with special focus on reusability, availability and scalability in AWS. You will have the opportunity to work on challenging platform and data-related problems and to have a measurable impact on the organization. Designing and building the evolution of data as a product including coordination across multiple systems, data privacy, data quality, and discoverability while introducing new ideas, patterns and technologies in support of our customers and internal stakeholders.

What You’ll Do

• Supporting us with evolving our data platform architecture
• Knowledgeable of implementing known patterns and their impact to a data platform, such as Event Driven, CQRS, event sourcing, Saga pattern, etc 
• Developing, documenting and communicating methods and processes to be utilized within our existing and future technology stack (DBT, Airflow, Snowflake, Kafka, Traditional ETL)
• In depth knowledge of AWS
• Experience with DW modeling (kimball, inmon, data vault and concepts such as data mesh) 
• Providing solutions for complex business problems, enabling insights that can empower better decision-making
• Provide technical leadership within the team and cross functionally 
• Develops strong working relationships with other leaders in the information technology organization by providing continuous assistance, technical acumen and thought leadership
• Collaborating with senior leadership on strategic data projects
• Takes an active role in fostering a culture of learning and excellence

The Skills and Experience You’ll Bring

• Bachelor’s degree in Computer Science, Computer Engineering or related technical discipline
• 7+ years of relevant engineering experience
• You are a strong data engineer having worked with DBT, Snowflake, Kafka, cloud based services (AWS S3, EMR, Glue)
• You bring hands-on experience in creating and managing an enterprise-scale Data Platform, while setting best practices for development teams, including security, privacy, monitoring & alerting, and CI/CD (ideally, AWS, Terraform, MySQL, Airflow, Tableau, Oracle, Snowflake)
• Leverage data to prioritize your work and to influence others
• Willing to implement change and improvements when seeing an opportunity
• Experience building and operating large scale, distributed systems
• Knowledge of professional software engineering practices and best practices for the full software development and technology management life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations; Agile a plus
• Excellent verbal and written communication skills
• Interest in continuous learning and improvement

 

Why DAT?
DAT is an award winning employer of choice.

For starters, we have a hybrid work environment, but we also know what makes a great workplace. We have a