Senior Staff Data Engineer

About Us

Funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV, Riverwood Capital, and others with over $290 million in funding, SecurityScorecard is the global leader in cybersecurity ratings and the only service with over 2M+ companies continuously rated. Founded in 2013 by security and risk experts Dr. Aleksandr Yampolskiy and Sam Kassoumeh, SecurityScorecard’s patented rating technology is used by over 16,000 organizations for enterprise risk management, third-party risk management, board reporting, due diligence, and cyber insurance underwriting. This is done by measuring your and your vendors' cyber-health by assigning a security rating of "A" through "F" based on outside-in, non-intrusive data. SecurityScorecard continues to make the world a safer place by transforming the way companies understand, improve and communicate cybersecurity risk to their boards, employees, and vendors. 

SecurityScorecard is headquartered in NYC with over 500 employees globally. Our culture has helped us be recognized by Inc Magazine as a "Best Workplace," "Best Places to Work in NYC" by Crain's NY, and one of the 10 hottest SaaS startups in NY for two years in a row.

What you will do

We are looking for a Senior Staff Data Engineer who thrives on building commercial products and plays a key role in delivering reliable, scalable, and maintainable applications. You will lead projects from start to finish, collaborating with Product Managers to define requirements, implement solutions, and ensure ongoing success post-deployment. You’ll focus on simplicity while contributing technical insights to enhance the system's performance, stability, and user experience.

• Participate in all stages of the software development life cycle, from design and development to deployment and maintenance.
• Influence the product and technical roadmap by providing data-driven insights and articulating the trade-offs between technical options and business goals.
• Mentor other engineers on the team through code reviews, pairing, and technical guidance, raising the bar for the entire team.
• Follow clean code principles, using best practices to write secure, testable, and well-documented software.
• Work closely with a global team, including engineers and product managers to build a stable, high-performance platform.
• Implement comprehensive testing and performance tuning to ensure system stability and uptime.

Responsibilities:

• Translate requirements, estimate effort, and address or escalate blockers as needed.
• Write clean, maintainable code that adheres to best practices in readability, design patterns, reusability, and testing.
• Own end-to-end projects, understanding and contributing to all aspects (infrastructure, application tiers, and data tiers).
• Continuously monitor performance metrics and recommend improvements or refactors.
• Make informed trade-off decisions between immediate delivery and long-term strategic goals.

Our Tech Stack:

• Scala, Apache Spark, Python
• Airflow
• ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect
• Docker, Jenkins, Terraform, AWS

Technical Skills: 

• 10+ years of experience working in the Data Engineering space, and with building and maintaining big data pipelines 
• 5+ years of experience working in agile environments (ideally Scrum), collaborating with cross-functional teams (engineering, design, product).
• Proficient in Spark
• Experience with strongly-typed languages (Java / Scala preferred)
• Experience designing, building, and maintaining RESTful APIs and integrating with external services.
• Participate in code reviews to ensure best practices, maintainability, and continuous improvement of the codebase.
• Ability to write and maintain unit and integration tests based on acceptance criteria, ensuring code quality and reliability.
• Proficiency with version control tools, particularly Git, for collaborative development and code management.

Nice to have:

• Strong understanding of building scalable and high-performance back-end systems, optimizing for low-latency and high-throughput.
• Worked with a variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, parquet).
• Experience in functional programming languages (Scala preferred)
• Experience in Cyber Security

Communication and Collaboration:

• Strong attention to documentation and maintaining standards across projects.
• Ability to present and defend technical decisions with confidence.
• Skilled at estimating proj