Senior/Staff Software Engineer, Data Platform

About Sovrn

Every interesting company solves essential problems for other people. Sovrn is a Software and Data business that helps Open Web businesses remain independent. We help them understand their business better, operate more efficiently, and make and keep more money.

• We believe in the freedom and free flow of information.
• We believe the Open Web is the largest source of this information.
• We believe in helping Open Web businesses be and remain Independent.

Through Software products and Data solutions, we help our customers:

• Understand their business better, so they can make better decisions.
• Operate their business more efficiently, so they can invest in what matters most.
• Make (and Keep) more money, so they control their own destiny.

About the Job

As a Senior or Staff Software Engineer, on the Data Platform team, you will collaborate with cross-functional teams to enhance our data architecture, troubleshoot data processing issues, and implement solutions to ensure the integrity, efficiency, and governance of our data ecosystem. The role requires strong problem-solving skills and expertise in managing and optimizing data pipelines (ELT). The ideal candidate is passionate about building and maintaining key datasets and data infrastructure, and has a proven track record in managing data platforms.

Languages / components / tools in our stack: Python, Redpanda/Kafka, Databricks/Spark, AWS/S3, Terraform, Datadog, GitHub

What You’ll Be Doing:

• Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications.
• Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies.
• Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
• Architect components and configurations required for data pipeline implementation in AWS and Databricks.
• Architect data pipeline metrics to monitor performance, accuracy, and availability.
• Enable a team to research, implement, and evolve methods to process our data.
• Optimize data processing and data access to business intelligence tools.
• Work across the organization to enable business growth and development through data services and data models.
• Spot and diagnose stability issues and author improvements.
• Lead the developers with the security team to implement and maintain robust data security measures.
• Ensure compliance with relevant data governance and privacy regulations.

The successful candidate will have:

• 5+ years of software engineering experience and a passion for learning
• Strong scala and python skills with an expert understanding of backend and data engineering design patterns
• A deep understanding of big data processing environments such as Spark and Databricks.
• Demonstrated experience with data processing using Spark in a production environment.
• Proven experience with orchestration tools such as Airflow and MWAA.
• Experience working in the Cloud Computing ecosystem. We use AWS heavily, but we are open to GCP, Azure, etc. 
• Experience with infrastructure as code tools like Terraform and AWS CloudFormation.
• Deep understanding of relational databases, big data tables, and noSQL databases.
• Able to triage, debug, and permanently fix complex and convoluted data processing issues.
• Possesses a mature understanding of the product domain and architecture.
• A strong individual contributor that can define and architect features required by the business and product.
• Learning to apply industry best practices, design principles, and design patterns.
• Executes on defined features of scope to achieve team goals and commitments.
• Sets standards and best practices around team conventions and precedent for solving recurring problems.
• Demonstrates an aptitude for writing clean, testable, readable, maintainable, quality code.
• Experiments and takes calculated risks around proof of concept and greenfield development, ensuring the team makes the best possible decisions when solving problems.
• Can set the standard and dictate the process for clear documentation and application coding processes.
• Desire for professional growth opportunities and to be in a dynamic learning environment
• Ability to efficiently multi-task and to work cooperatively and collaboratively with all levels of employees to maximize performance, creativity, prob