Staff Software Engineer, Data

About Sovrn

Every interesting company solves essential problems for other people. Sovrn is a Software and Data business that helps Open Web businesses remain independent. We help them understand their business better, operate more efficiently, and make and keep more money.

• We believe in the freedom and free flow of information.
• We believe the Open Web is the largest source of this information.
• We believe in helping Open Web businesses be and remain Independent.

Through Software products and Data solutions, we help our customers:

• Understand their business better, so they can make better decisions.
• Operate their business more efficiently, so they can invest in what matters most.
• Make (and Keep) more money, so they control their own destiny.

About the Job

The Data Solutions team manages the end-to-end lifecycle of Sovrn’s data assets, operating a high-volume public API and Data-as-a-Service (DaaS) feeds for B2B customers. They focus on maintaining and evolving the data platform, with a strong emphasis on architecture, transformation, availability, governance, and ensuring critical insights are accessible to internal leaders. As a Staff Software Engineer, you will collaborate with cross-functional teams to enhance data architecture, troubleshoot issues, and ensure the integrity and efficiency of our data ecosystem, requiring strong problem-solving skills and expertise in managing data pipelines (ELT).

What You’ll Be Doing:

• Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications.
• Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies.
• Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
• Architect components and configurations required for data pipeline implementation in AWS and Databricks.
• Architect data pipeline metrics to monitor performance, accuracy, and availability.
• Enable a team to research, implement, and evolve methods to process our data.
• Optimize data processing and data access to business intelligence tools.
• Work across the organization to enable business growth and development through data services and data models.
• Spot and diagnose stability issues and author improvements.
• Lead the developers with the security team to implement and maintain robust data security measures.
• Ensure compliance with relevant data governance and privacy regulations.

The successful candidate will have:

• 7+ years of software engineering experience and a passion for learning
• Strong scala and python skills with an expert understanding of backend and data engineering design patterns
• A deep understanding of big data processing environments such as Spark and Databricks.
• Demonstrated experience with data processing using Spark in a production environment.
• Proven experience with orchestration tools such as Airflow and MWAA.
• Experience working in the Cloud Computing ecosystem. We use AWS heavily, but we are open to GCP, Azure, etc. 
• Experience with infrastructure as code tools like Terraform and AWS CloudFormation.
• Deep understanding of relational databases, big data tables, and noSQL databases.
• Able to triage, debug, and permanently fix complex and convoluted data processing issues.
• Possesses a mature understanding of the product domain and architecture.
• A strong individual contributor that can define and architect features required by the business and product.
• Learning to apply industry best practices, design principles, and design patterns.
• Executes on defined features of scope to achieve team goals and commitments.
• Sets standards and best practices around team conventions and precedent for solving recurring problems.
• Demonstrates an aptitude for writing clean, testable, readable, maintainable, quality code.
• Experiments and takes calculated risks around proof of concept and greenfield development, ensuring the team makes the best possible decisions when solving problems.
• Can set the standard and dictate the process for clear documentation and application coding processes.
• Desire for professional growth opportunities and to be in a dynamic learning environment
• Ability to efficiently multi-task and to work cooperatively and collaboratively with all levels of employees to maximize performance, creativity, problem solving and results
• A creative yet anal