Principal Data Engineer

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

Responsible for designing, building and overseeing the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required. Develops technical tools and programming that leverage artificial intelligence, machine learning and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis. Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. Work with data modelers/analysts to understand the business problems they are trying to solve then create or augment data assets to feed their analysis. Acts as a technical expert in own area within the organization. May work independently or as part of a team on more complex projects. Provides mentoring and guidance to more junior team members.

Job Description

This role is based in our downtown Philadelphia headquarters. It is not approved for remote or virtual employment.

This Engineer 5, Data Engineer contributes to internal strategy and roadmap for one or more areas of Xfinity Mobile wireless and new wireless growth initiatives in Comcast Emerging Wireless.

Core Responsibilities

• Manages development of data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs.
• Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.
• Guides creation of standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.
• Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.
• Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.
• Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks. 
• Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.
• Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes. 
• Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.
• Creates establishes and oversees design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements.
• Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
• Develops