Senior Python Developer, AVP - Onsite

Who we are looking for

We are seeking a highly skilled Senior Python Developer with extensive experience working with data to join our team. The ideal candidate will have a strong background in Python, Spark, and PySpark, as well as experience in shell scripting, SQL while following the Software Development Life Cycle (SDLC) processes. You will be responsible for ensuring high-quality code through rigorous testing practices and be involved in designing and developing scalable data solutions. You will use your knowledge of object-oriented design best practices to solve challenging problems in the trading systems space.

ONSITE: Due to the role requirements this job needs to be performed primarily in the Boston office OR Canada Office with some flex work opportunities available.

Interview: 1st interview will be via Video and second interview will be onsite

What you will be responsible for

• Work independently and within team settings to analyze, design, develop, test, and debug large and complex software enhancements and solutions

• Design, develop, and maintain scalable data processing applications using Python and PySpark

• Participate in all phases of the Software Development Life Cycle (SDLC), including requirements gathering, design, development, testing, deployment, and maintenance

• Implement best practices in coding, testing, and documentation, ensuring high-quality code delivery

• Develop and maintain unit tests, integration tests, and automated test suites to ensure the robustness of data solutions

• Work closely with data engineering teams to build and optimize data pipelines on distributed systems (e.g., Spark, Hadoop)

• Leverage your expertise in shell scripting to automate data workflows and ensure system reliability

• Write and optimize complex SQL queries for data extraction, transformation, and analysis

• Collaborate with data scientists, analysts, and other developers to implement robust data solutions

• Lead code reviews, provide mentorship to junior developers, and advocate for test-driven development (TDD) and continuous integration (CI/CD) practices

• Monitor, troubleshoot, and improve the performance of existing framework and python code

• Ensure proper documentation and testing of all data solutions developed

What we value

These skills will help you succeed in this role

• 5+ years of professional experience in Python development, with a focus on data-intensive applications

• Proven experience with Apache Spark and PySpark for large-scale data processing

• Strong hands-on experience with shell scripting (e.g., Bash) for automating tasks and data workflows

• Solid understanding of SQL and experience working with relational databases (e.g., Oracle, sparkSQL) and query optimization

• Experience in SDLC, particularly in applying software development best practices and methodologies

• Experience in creating and maintaining unit tests, integration tests, and performance testing for data pipelines and systems

• Familiarity with big data platforms like Hadoop, Hive, or Databricks

• Experience with cloud platforms such as AWS for data infrastructure and services is preferred

• Familiarity with version control systems like Git and CI/CD pipelines for automated testing and deployment

• Excellent problem-solving skills and the ability to work independently and collaboratively in a team environment

• Strong communication skills and the ability to present technical concepts to both technical and non-technical stakeholders

• Excellent object-oriented design skills

Education & Preferred Qualifications

• Masters or B.S. degree in Computer Science or related field

• 8+ years’ experience developing object-oriented software such as Java

• Experience in financial industry or trading systems is a plus

Additional requirements

• Knowledge of data formats like AVRO, Parquet, and working with complex data types

• Experience with Apache Kafka for real-time data streaming and Kafka Streams for processing data streams

• Experience with Airflow for orchestrating complex data workflows and pipelines.

• Expertise or interest in Linux

• Exposure to data governance and security best practices in data management.

Are you the right candidate? Yes!

We truly believe in the power that comes from the diverse backgrounds and experiences our employees bring with them. Although each vacancy detail