Data Engineering - Market Data Engineering - Software Engineer - Associate - New York

 

Who We Are: Market Data Engineering

Market Data Engineering is part of the firm’s Data Engineering group handling global access to financial market data sourced both internally and externally from the firm. The team is currently undertaking a project to revolutionize data ingestion, curation and distribution and is looking for talented engineers to ensure delivery success!

Your Impact

This is a rare opportunity to work on the internals of a time-series database engine for real-time data. With capture rates of over 1Tb per day, and data stores containing over 1Pb, this requires highly efficient, scalable software. We are looking for a developer with strong technical skills, who would like innovate using the latest ideas in distributed computing to drive the platform forwards.

 

The database is used by trading desks and other users for the recording and analysis of market data. We work closely with these users to meet their needs in terms of timely data access and processing. We are developer-maintainers and hence develop all the tools to deploy and maintain the infrastructure ourselves.

 

We are a key part of GS’s financial cloud strategy. We are actively developing this database in AWS for use by both internal and external clients. See https://developer.gs.com/discover/data.

How You Will Fulfil Your Potential

• Develop the core of our in-house C++ distributed database so it can fulfil its goals in terms of performance and scalability
• Work with the front office and external users to meet business needs for data analytics and performance
• Develop and improve our operational tools to solve infrastructure issues and analyse performance bottlenecks
• Provide support for our global infrastructure

Skills and Experience We’re Looking For

Basic Qualifications

• 1 - 5 years’ experience developing high-performance software in C++ or Java
• A strong desire to produce organised, readable and maintainable software 
• Effective communicator in both written and verbal mediums 
• Proven problem solving ability with critical and creative thinking
• Ability to balance multiple, time-sensitive projects while maintaining a longer term, strategic focus 

Preferred Qualifications

• Knowledge of Java, Python, Javascript, SQL/No-SQL databases, Docker, Kubernetes
• Strong Linux knowledge
• Experience with AWS, terraform, or CDK.
• A passion for taking ownership of a software stack and developing it to its full potential
• Prior experience working on electronic trading systems, data feeds or database engines