Sr. Director, Data Engineering & Operations

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast.

Job Summary

Leads multiple data engineering teams to design, build, and operate scalable data platforms and pipelines for structured and unstructured data across cloud and on-prem environments. Establishes processes and standards for ingestion, transformation, lineage, security, and data quality, leveraging AI/ML and big-data techniques to automate and protect data integrity. Partners with business and technology stakeholders to translate requirements into architecture and platform choices, recommending upgrades and ensuring compatibility across systems. Owns program delivery (scope, quality, budget, schedule) and contributes to organizational strategy and objectives.

Job Description

Core Responsibilities

• Manages development of data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs. 

• Emphasizes data quality during ingest, processing as well as final load to the target tables. 

• Guides creation of standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed. 

• Manages creation of standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces. 

• Manages the creation and maintenance of information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces. 

• Oversees the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks.   

• Advises on the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements. 

• Educates team on data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes.   

• Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization. 

• Oversees design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. 

• Develops strategies for data acquisition, archive recovery, and database implementation. 

• Manages data migrations/conversions and troubleshooting data processing issues. 

• Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities. 

• Guides critical issue resolutio