Senior Data Engineer (REMOTE)

Are you passionate about data and serving a community of music lovers? Do you possess strong pipeline building skills and strive to provide a premium platform to your job? If so, our Engineering team here at Discogs is looking for you!

Location

This is a remote position. Open to candidates located in OR, WA, CA, CO, ID, AZ, TX, IL

Who We Are

Discogs is the largest crowd-sourced, community-driven database of recorded music information in the world. Every day, millions of people use the Discogs Marketplace to connect, learn about music, and buy and sell vinyl records, CDs, and cassettes. As Discogs continues to grow, we are looking for bright, dedicated, creative, and highly motivated people to help us realize our mission to serve the music fan in everyone. We are relatively small, so individual contributions can have a large impact. High value is placed on quality, critical thinking, and continuous improvement. Our teams work collaboratively but are distributed geographically and open-source tools are important to who we are and how we work. We value the experiences and skills each team member contributes to helping us serve our music community.

Who We’re Looking For

The Senior Data Engineer is focused on building our modern data platform. Our modern data platform uses streaming and batch data tools to make our data secure, available, scalable, and power data products and business analytics.

What You’ll Accomplish

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

• Makes key contributions to defining the Discogs’ data strategy. Along with planning, writing, and deploying data pipelines, is responsible for unit testing, and championing reliability and security while quickly delivering value to the business.
• Works with other agile delivery team members to design, implement, and optimize data pipelines, data processing, and other data needs.
• As a data team member, leans on using functional programming practices and performs end-to-end data testing.
• Applies understanding of data engineering methodologies, processes, and tools to create a unified Discogs’ experience across a variety of platforms and devices for a global audience.
• Communicates effectively with tech and non-tech members and is capable of delivering feedback to peers and their lead.
• Assists squad with estimation and prioritization of data efforts.
• Actively engages with members across the organization to design and deploy useful data services.
• Coaches and mentors other data engineers by providing recommendations, technical oversight, reviews, and feedback.
• Capable of delivering data pipelines and architecture from technical design to launch with little oversight.
• Collaborates closely with the Business and with other Engineering Teams to quickly deliver high quality products that maximize value to the Discogs ecosystem.
• Other duties as assigned.

Requirements

What You’ll Contribute

Minimum Experience and Education

Must Have:

• 7+ years of data engineering experience
• Experience building robust Batch and Streaming Data Pipelines
• Experience working with Apache Kafka and Kafka Connect
• Experience with orchestration or scheduling tools (Airflow, StepFunctions, Cron, etc)
• Strong skills in languages such as SQL and Rust
• Strong skills with AWS services (S3, EKS, etc )
• Thoroughly understands the business vision, mission, and strategy and how their code supports and affects business outcomes.
• Shows initiative and seeks evidence in data to support ideas.

Great to have:

• Experience with change data capture (CDC) tools (Debezium)
• Understanding of business intelligence tools (Metabase, Looker, etc)
• Understanding of data analysis, data modeling, and data visualization
• Strong understanding of data security and privacy
• 2+ years of experience working in Agile/Scrum/Kanban teams

Education:

• Bachelor's degree from four-year college or university, or equivalent technical work experience

Benefits

What We Provide

• Competitive compensation: salary, plus performance-related bonus program
• 401(k) with employer match
• 100% company-paid medical and dental insurance benefits for you and your dependents
• 4 weeks paid vacation, increasing based on tenure
• 18 weeks paid leave for birth moms
• 8 weeks paid parental leave, including for adoption
• Monthly wellness allowance
• Annu