Principal Data Engineer, Full Stack

Benefits Overview

A career at CoBank can offer you the opportunity to make a personal impact on the people and communities where we do business. When you choose a career with CoBank, you make a difference by standing for something that matters. In order to be the best, we hire the best!

Remarkable Benefits Offered by CoBank

• Careers with a purpose. Stand for something!
• Time-Off Packages, boasting over 15 days of vacation, 10 paid sick days and 11 paid holidays
• Competitive Compensation & Incentive
• Hybrid work model: flexible arrangements for most positions
• Benefits Packages, including Medical, Dental and Vision coverage, Disability, AD&D, and Life Insurance
• Robust associate training and development with CoBank University
• Tuition reimbursement for higher education up to $10,000 per year
• Outstanding 401k: up to 6% matching and additional 3% non-elective contribution
• Community Impact: United Way Angel Day, Volunteer Day and Associate Directed Contribution
• Associate Resource Groups: creating a culture of diversity and inclusion
• Recognize a fellow associate through our GEM awards

Job Description

CoBank is looking for a Principal Data Engineer, Full stack to join our Data Engineering (DE) team which is responsible for building and maintaining our data lake, developing ingestion / and consumption data pipelines / services, and facilitating the movement of large data each dayautomation of large-scale data ETL and analytics each. We work directly with business teams and platform and engineering teams to ensure growth strategies at CoBank. You are an out-of-the-box, structured thinker who is passionate about building services that scale. You will play a key role in providing the end-to-end data engineering and analytics solutions to support key business initiatives. As a Principal Data Engineer at CoBank, you will play a pivotal role in driving the design, development, and optimization of our data infrastructure and architecture. You will lead the implementation of complex data engineering and analytics solutions, leveraging cloud-native technologies, particularly AWS services and open-sourced software. You will collaborate closely with cross-functional teams to ensure the successful delivery of data-driven initiatives aligned with the organization's strategic objectives. Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions in full-stack development tools and technologies. Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community.

Essential Functions

1. Lead team(s) in design, implementation and automation of highly scalable data pipelines and ETL processes. Collaborates with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies. 2. Develop and maintain data and analytics pipelines using Python, SQL, Terraform, Open-Source databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. 3. Architect and optimize data storage and retrieval mechanisms, leveraging cloud-native solutions. 4. Drive data governance, quality, and metadata management initiatives. 5. Mentor junior engineers and promote innovation within the team. 6. Communicate effectively with stakeholders at all levels to ensure alignment on data initiatives.

Education

• Bachelor's Degree in computer science, information technology or a related field required
• Bachelor's degree may be substituted with four years of related experience (four years is in addition to what is minimally required for the role), or an equivalent combination of education and related experience
• Master's Degree in computer science, information technology or a related field preferred

Work Experience

8 years of relevant experience in data engineering, with a proven track record of designing and implementing scalable data solutions. The experience can be compensated by experience in software engineering such as front end and back-end development required Prior Experience in a leadership or senior technical role within a data engineering team required Prior Experience with cloud platforms, particularly AWS, and proficiency in leveraging AWS native services for data processing, storage, and analytics required Prior Experience in python and open-sourced frameworks required Prior Experience in pipeline/process/workflow automation preferred Prior Experience with other cloud platforms, such as Google Cloud Platform (GCP) or Microsoft Azure preferred Prior Experience with on-premises d