Senior Data Engineer

The Senior Data Engineer plays a critical role in the successful execution of Allied’s Data Strategy. This role will be focused on data acquisition, curation, and transformation of data into a useable asset. They will work cross-functionally to develop and deploy optimized data models and modern data architecture in support of strategic data and business initiatives. This role will serve as a subject matter expert for data domain knowledge, SQL, data design, and data processes across the enterprise. This individual will collaborate with teams across the organization to design and build end to end data flows for optimal business intelligence, advanced analytics, and data monetization efforts. Lastly, this role will contribute to core design of data architecture, data models, schemas, and inform future state Data Management and Data Strategy roadmaps.

Job Duties and Responsibilities

• Creates detailed documentation of data warehouse, data stores, and end-to-end data flows

• Troubleshoots and corrects data and data processing errors in existing solutions

• Works with other technical teams as well as with internal and external users to develop technical designs

• Develops and continually refines the BI-focused data architecture

• Works closely with the Data Intelligence department to understand the data and reporting requirements from internal and external customers and the steps to take on the back-end data side to achieve the expected results

• Conducts gap analysis on source system databases against Allied’s enterprise data warehouse in support of Business Intelligence efforts

• Develops and maintains data sets and standardizes data collection and processing methodologies

• Provides technical advice and weighs in on technical decisions that impact cross-functional teams

• Attends and contributes to architecture meetings to determine project scope, time frame, and cost estimates

• Works on plan and technical architecture to extract, integrate, and/or push data to or from third-party providers

• Provides enterprise data solutions for Allied, including ETL maintenance, warehouse data models, periodic upgrades, security, governance, and performance optimization

• Understands the data warehouse and data mart models as well as being familiar with the business information contained in each

• Locates and defines new process improvement opportunities or alternative technologies that will enhance speed to business value delivery with our data

• Collaborates with developers and subject matter experts to establish the technical vision and analyze tradeoffs between usability and performance needs

• Mentors other ETL Developers and Data Engineers

Qualifications (Education, Experience, Certifications & KSA)

• ​ Bachelor’s Degree required, or equivalent education/work experience

• 5+ years of experience with data warehousing, databases (MS SQL Server, Snowflake), and dimensional modeling 

• 5+ years of experience in end-to-end data analysis and development

• 3-5 years of experience in AWS cloud services (AWS Glue, Lambda, S3, etc.)

• 3-5 years of experience with Snowflake (Snowpipe, Snowpark, Streamlit, Streams/Tasks) (preferred)

• Extensive Experience with SQL required

• Experience with R or Python (preferred)

• Experience with Git and CI/CD (preferred)

• Strong attention to detail

• Familiarity with Object Oriented Analysis, Project Management, Business Analysis Methodology, and the SDLC

• Ability to collaborate effectively and work as part of a team

• Customer-oriented, with a desire to resolve problems to the customer's satisfaction while maintaining focus on productivity, efficiency, and quality

• Effective communicator to clients, management, and project partners

• Experience with cloud-based technologies and services (SaaS, PaaS, IaaS) (preferred)

• Experience with Master Data Management (preferred)

• Strong analytical and product management skills required, including a thorough understanding of how to interpret customer business needs and translate them into application and operational requirements.

The above statements are intended to describe the general nature and level of work being performed by people assigned to this job. They are not intended to be an exhaustive list of all responsibilities, skills, efforts or working conditions associated with a job.

We offer our employees a robust compensation package! Our comprehensive benefits include: medical, dental and vision insurance coverage; 100% company-paid life