Principal Data Engineer

Job Description:

Position Description: 

***Multiple Positions Available*** 

Designs and architects Cloud native applications using Amazon Web Services (AWS). Coordinates relational databases and data operations using standardized programming languages (SQL and Oracle PL). Provides a single platform for data warehousing, lakes, engineering, science, application development, and secure sharing and consumption of data using Software-as-a-Service (SaaS) and Snowflake. Automates the integration of code changes from contributors into single software projects using Continuous Integration and Continuous Development (CI/CD) practices and open-source platforms using Jenkins. Automates manual processes using Python and Shell Scripting. Adheres to Agile practices to enhance firm efficiency. Promotes the development of Data Applications and Frameworks using Python and Spark. Creates efficient designs for data storage and retrieval for both applications and batch processing using SQL performance tuning.   

Primary Responsibilities: 

• Participates in architecture design teams. 

• Defines and implements application-level architecture. 

• Develops applications on complex projects, components, and subsystems for the division. 

• Recommends development testing tools and methodologies and reviews and validates test plans. 

• Responsible for QA readiness of software deliverables. 

• Develops comprehensive documentation for multiple applications or subsystems. 

• Establishes full project life cycle plans for complex projects across multiple platforms. 

• Responsible for meeting project goals on-time and on-budget. 

• Advises on risk assessment and risk management strategies for projects. 

• Plans and coordinates project schedules and assignments for multiple projects. 

• Acts as a primary liaison for business units to resolve various project/technology issues. 

• Provides technology solutions to daily issues and technical evaluation estimates on technology initiatives. 

• Advises senior management on technical strategy. 

• Mentors junior team members. 

• Performs independent and complex technical and functional analysis for multiple projects supporting several divisional initiatives.  

• Develops original and creative technical solutions to on-going development efforts. 

Education and Experience: 

Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and five (5) years of experience as a Principal Data Engineer (or closely related occupation) building CI/CD pipelines for software applications in a hybrid cloud environment. 

Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics or a closely related field and three (3) years of experience as a Principal Data Engineer (or closely related occupation) building CI/CD pipelines for software applications in a hybrid clou