Lead Associate Principal, Software Engineering: Middleware
OCCAbout the role
What You'll Do:
We are seeking a highly skilled and experienced Infrastructure Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security. You will play a crucial role in automating infrastructure provisioning, deployments, and operations, enabling our organization to rapidly deliver and scale applications.
Primary Duties and Responsibilities:
To perform this job successfully, an individual must be able to perform each primary duty satisfactorily.
Design, implement and manage highly available and scalable Kafka clusters.
Monitor Kafka performance, troubleshoot issues and optimize configurations.
Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
Create and maintain reusable IaC modules.
Design and implement cloud-based infrastructure solutions on AWS and Azure.
Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
Deploy and Manage containerized applications using Kubernetes and Rancher
Troubleshoot container-related issues and optimize container performance.
Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.
Automated the build, test and deployment of middleware components.
Integrate IaC and container technologies into CI/CD pipelines.
Document all processes and procedures.
Work with development teams to ensure smooth deployments.
Supervisory Responsibilities:
None
Qualifications:
The requirements listed are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the primary functions.
Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
Extensive experience with cloud automation and provisioning on AWS and Azure.
Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
Strong scripting skills in languages like Python and Bash.
Excellent troubleshooting and problem-solving skills
Understanding of networking principles.
Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana.
Technical Skills:
- Kafka, Ansible, Terraform, Bash, Kubernetes, Rancher, GitHub, Artifactory, Harness, Jenkins, AWS, Azure, CI/CD, IaC, Automated Cloud Provisioning
Education and/or Experience:
Bachelors degree in Computer Science, Engineering or a related field (or equivalent experience)
10+ years of experience in infrastructure middleare administration.
In-depth expertise in Kafka administration, including cluster management, performance tuning, and security.
Certificates or Licenses:
AWS Solutions Architect, CKAD or CKA certifications preferred.
About Us
The Options Clearing Corporation (OCC) is the world's largest equity derivatives clearing organization. Founded in 1973, OCC is dedicated to promoting stability and market integrity by delivering clearing and settlement services for options, futures and securities lending transactions. As a Systemically Important Financial Market Utility (SIFMU), OCC operates under the jurisdiction of the U.S. Securities and Exchange Commission (SEC), the U.S. Commodity Futures Trading Commission (CFTC), and the Board of Governors of the Federal Reserve System. OCC has more than 100 clearing members and provides central counterparty (CCP) clearing and settlement services to 19 exchanges and trading platforms. More information about OCC is available at www.theocc.com.
Benefits
A highly collaborative and supportive environment developed to encourage work-life balance and employee wellness. Some of these components include:
- A hybrid work environment, up to 2 days per week of remote work
- Tuition Reimbursement to support your continued education
- Student Loan Repayment Assistance
- Technology Stipend allowing you to use the device of your choice to connect to our network while working remotely
- Generous PTO and Parental leave
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s