Principal Data Engineer (Remote)

Date Posted:

2023-11-20

Country:

United States of America

Location:

HTX99: Field Office - TX Remote Location, Remote City, TX, 73301 USA

Position Role Type:

Remote

Do you want to be part of the team that builds the Data Platform at the center of Transforming the Aviation Industry? 

 

As a Principal Data Engineer, you will be on a mission to ensure that our Data Platform can leverage data from various sources to help transform the passenger journey as well as help our customers leverage data to improve their operations.   This role is responsible for the design, development and maintenance of data processes and pipelines supporting critical Strategic Business Unit (SBU) Data initiatives in support of the Digital Transformation. The scope of the role encompasses many facets of the aviation industry. You will work with Data Scientists and Application Developers to build data-based products that benefit commercial airlines, airports and passengers.  Your work will influence the next generation of connected aviation products.

You will work with a team where you will be able to share your ideas and vulnerabilities and will be treated with care and empathy. You will work with a team that shows courage in doing the right thing, not because it is easy. This is a great opportunity with room to grow and learn about new and interesting technology solutions.

Our business unit, Connected Aviation Solutions (CAS), is leading the Connected Ecosystem strategic pillar for Collins Aerospace. The Data Management & Data Science (DM&DS) team has end-to-end responsibility to ensure that CAS data assets are managed with integrity and quality prior to consumption by our critical customer facing applications - whether via API’s, analytics and/or data visualizations.

 

What YOU will do:

• YOU will contribute to establishing Data Engineering best practices, building the DataOps model and enabling the ML and AI roadmap of the future.

• YOU will develop automation and monitoring processes that support the data pipelines.

• YOU will work closely with the architecture team to implement modern data repositories that support the CAS use cases (Pipelines, API’s, Data Science, Applications and Visualizations).

• YOU will work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption.

• YOU will work with the CAS and DT Enterprise Data Architects to automate cloud deployments, as well as build CI/CD pipeline to support cloud-based workloads. This includes developing views, materialized views, and SQL scripts.

• YOU may travel domestically and internationally up to 15%.

• YOU will work on a distributed and diverse team that collaborates and communicates well. 

 

What YOU will learn:

• YOU will learn all about the datasets that are produced in the aerospace ecosystem; such as how the various components in an aircraft interact with each other.

• YOU will learn how to enable Data Scientists to perform ML and AI experiments.

• YOU will gain exposure to large scale data processing leveraging modern technology stacks including Databricks and AWS native services.

• YOU can take flight to becoming a subject matter expert and leader in Data Engineering with exposure to the variety of business and products in an ever-evolving aerospace industry. CAS is growing and so can you.

 

Education & Experience:

• Typically requires a degree in Science, Technology, Engineering or Mathematics (STEM) unless prohibited by local laws/regulations and minimum 8 years prior relevant experience or an Advanced Degree in a related field and minimum 5 years of experience or in absence of a degree, 12 years of relevant experience.

 

Qualifications You Must Have:

• Must be authorized to work in the U.S. without sponsorship now or in the future. RTX will not offer sponsorship for this position.

• Demonstrated engineering experience in system integration and design, data pipeline development, or software/service development and deployment.

• Experience building data pipelines leveraging tools like Spark, Python, PySpark & SQL as well as working with AWS/Azure Cloud platforms and related services and Terraform, Gitlab and similar CI/CD tools.

• Experience with Databricks Platform and leveraging that platform to build out a Data Lake.

 

Skills We Value:

• Professional background developing complex SQL queries and programming in Python with ability to transform raw data into valuable insights.

• Experience designing cloud-based data platforms that ensure cost optimization, scalability, perform