Data Engineer 1

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Summary

We are seeking a Data Engineer to design, build, and optimize scalable, high-performance data pipelines. The ideal candidate will have expertise in big data processing frameworks, data storage technologies, and monitoring platforms while thriving in a collaborative, fast-moving environment. If you are a problem solver, a mentor, and someone who enjoys pushing the boundaries of data engineering, this is the opportunity for you!

Job Description

Core Responsibilities:

• Own the complete software development lifecycle—from design to deployment—of scalable batch and streaming data pipelines to ingest and transform large datasets from various sources. 

• Optimize streaming and batch data processing to ensure performance, scalability, and cost efficiency. 

• Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability. 

• Maintain and enhance FreeWheel's internal monitoring platform, ensuring comprehensive observability and operational excellence for the entire Streaming Hub and Audience Platform. 

• Collaborate with product managers and stakeholders to understand data requirements and deliver solutions that drive business impact. 

• Effectively communicate technical concepts to non-technical stakeholders. 

• Stay ahead of emerging data engineering technologies and best practices, identifying opportunities to improve processes, tools, and infrastructure. 

• Document data pipelines, processes, and systems to ensure clarity and maintainability. 

• Must be available to work Eastern Standard Time (EST) hours and be open to variable schedules, including nights, weekends, and overtime as needed. 

• Consistent exercise of independent judgment and discretion in matters of significance.   

• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.   

• Other duties and responsibilities as assigned.  

 

Qualifications: 

• Bachelor’s or master’s degree in computer science, Engineering, or a related field. 

• Familiarity with programming languages, including Scala, Java, Python, and SQL. 

• Exposure to big data processing frameworks, such as Apache Flink, Apache Spark (Batch & Streaming), and Databricks Delta Live Tables (DLT). 

• Understanding of data storage technologies, including AWS S3, Delta Lake, Apache Iceberg, Hadoop HDFS, and Apache Druid. 

• Familiarity with Data Lakehouse architectures, data modeling techniques, ETL processes, and relational databases (e.g., MySQL). 

• Basic Knowledge of Data Modeling techniques and Relational databases such as MySQL 

• Exposure to AWS services such as EMR and Lambda and workflow orchestration tools such as Airflow 

• Awareness of NoSQL databases and their pros and cons  

• Strong problem-solving skills with a keen attention to detail. 

• Excellent communication and collaboration skills to work effectively with technical and non-technical teams. 

• Generalist mindset with the ability to work across different technology stacks and polyglot programming skills, demonstrating