Data Engineer

About You.com

You.com is the world's first AI assistant for chat, search, code and creative generations. It summarizes the web for users, with superior privacy choices, and personalization.

About The Role:

Are you passionate about data engineering, analytics, and driving insights to support important business decisions? Do you thrive in a collaborative and fast-paced environment? If so, we have an exciting opportunity for you to join our team as a Data Engineer, leading our data engineering efforts for analytics.

Responsibilities

• Lead data engineering projects that drive collaboration across the company to obtain insights from data sources including clickstream, marketing, product funnels, etc., and use that to support important business decisions

• Help build data architectural patterns and ETL processes that are scalable and extensible to understand our growing user base

• Contribute to a healthy and supportive culture of code review and strong coding practices

• Efficiently operate and manage resources in an Azure or AWS environment using tools like Terraform

• Add new sources, build new tools, and produce new metrics that empower Product, Marketing, and Data Scientists

• Implement feature engineering and data enrichment techniques for a large-scale consumer and business-to-business product

• Optimize data pipelines for performance, scalability, and reliability

Background

• A BS in Computer Science or equivalent 3+ years of professional experience as a Data Engineer or in a similar role

• Experience working with distributed processing frameworks: Databricks/Spark and stream processing, event-driven technologies such as Kafka, and are happy working with these systems via REST and Python APIs

• Strong experience with Python, Spark, including Spark SQL, DataFrames, Spark Streaming, RDD caching, Spark MLib and the ability to write, debug, and optimize Spark code

• Proficiency in using Terraform for infrastructure as code

• A strong DataOps mindset and opinions on next-generation warehousing tools and ETL processes

• Experience working with cloud platforms such as Azure and AWS

• Strong problem-solving and analytical skills

• Excellent written and verbal communication skills, capable of translating complex technical subjects into clear and concise terms.

• You have a passion for engineering excellence and tolerance for ambiguity in a fast-paced setting

• Experience with schema design and data modeling, with a passion for elegant and intuitive dataset design

If you are an ambitious and skilled Data Engineer seeking an exciting and challenging role, we would love to hear from you. Join our team and contribute to our data-driven success!