Machine Learning Senior Software Engineer (AWS, LLMs, Python)

We are seeking a highly skilled Machine Learning Engineer with strong experience in AWS, Large Language Models (LLMs)—especially Amazon Bedrock, Python, and modern CI/CD pipelines (Jenkins or GitLab). You will help design, build, and deploy scalable ML systems, integrate generative AI capabilities, and support end-to-end model lifecycle workflows in production.

Essential Job Functions:

• Design, build, and deploy machine learning models and pipelines using Python, AWS services, and Amazon Bedrock.

• Develop scalable APIs and microservices to expose ML/LLM capabilities using FastAPI

• Build automated CI/CD pipelines using Jenkins or GitLab CI/CD for model training, testing, and deployment with robust monitoring, logging, and alerting for ML systems in production.

• Optimize ML workloads using AWS services such as SageMaker, Lambda, ECS/EKS, Step Functions, and KMS. 

• Familiarity with containerization using Docker and orchestration with ECS, EKS, or Kubernetes..

• Experience implementing RAG pipelines with vector databases (e.g., OpenSearch, Pinecone, DynamoDB, Aurora PostgreSQL + pgvector)

• Knowledge of modern MLOps tools (MLflow, SageMaker Pipelines, Weights & Biases)

• Experience working with API frameworks (FastAPI, Flask)

• Background in security, compliance, or responsible AI principles.

 

Education/Experience Requirements: 

• Bachelor’s degree in Computer Science, Information Systems or related discipline with at least 5 years of related experience, or equivalent training and/or work experience.

• System design experience

• Strong experience in object-oriented development

• Strong experience with cloud technologies

• Strong experience in data storage technologies

• Experience in performance tuning and optimization

• Experience in DevOps and CI\CD technologies

• Experience test automation and unit testing

• Experience software security

Working Conditions:

• Hybrid work environment, with defined in-person presence requirements.

• Occasional travel and extended hours may be required.

For work that is performed in CO, FL, TX, IL, PA, MA, MD, VA, Washington, DC, NY and NJ, please refer to the chart below for the salary range for the corresponding location. FINRA complies with all state and local pay transparency laws and regulations requiring the disclosure of salary ranges for the position. In addition to location, actual compensation is based on various factors, including but not limited to, the candidate’s skill set, level of experience, education, and market considerations. 

 

CO/FL/TX: Minimum Salary $95,300, Maximum Salary $171,800

IL/PA: Minimum Salary $104,900, Maximum Salary $189,400

MA/MD/VA/Washington, DC: Minimum Salary $109,600 Maximum Salary $197,600

NY/NJ: Minimum Salary $109,600, Maximum Salary $206,200

#LI-Hybrid

To be considered for this position, please submit an application. Applications are accepted on an ongoing basis.

The information provided above has been designed to indicate the general nature and level of work of the position. It is not a comprehensive inventory of all duties, responsibilities and qualifications required.

Please note: If the “Apply Now” button on a job board posting does not take you directly to the FINRA Careers site, enter www.finra.org/careers into your browser to reach our site directly.

FINRA strives to make our career site accessible to all users. If you need a disability-related accommodation for completing the application process, please contact FINRA's Employee Relations team at 240.386.4865 or by email at EmployeeRelations@finra.org. Please note that this process is exclusively for inquiries regarding application accommodations. 

Employees may be eligible for a discretionary bonus in addition to base pay. Non-exempt employees are also eligible for overtime pay in accordance with federal, state, or local law. As part of its dedication to employee wellness, FINRA provides comprehensive health, dental and vision insurance. Additional insurance includes