Machine Learning - Software Engineer - Python, Mongo, Jupyter

Erias Ventures was founded to serve its customers with an entrepreneurial mindset. We value creative problem-solving, open communication, and empowering our employees to make decisions and put forth new ideas.

Our staff includes technical experts working across multiple disciplines, bringing diverse perspectives to every project. We are seeking engineers who wish to grow their careers and want to become part of a technically strong and growth-oriented company focused on bringing innovative solutions to the difficult mission problems facing our customers.

Description
We're seeking a Software Engineer to bridge the critical gap between cutting-edge ML research and production-ready solutions. You'll transform research prototypes into robust, deployable systems that end users can confidently put into production. This role uniquely combines software engineering, DevOps practices, and ML solution delivery.

• AI Model Benchmarks: Design, implement, and maintain benchmark suites that measure model performance against defined evaluation criteria, including dataset curation, scoring, and results reporting.
• Agentic AI Benchmarks: Develop benchmarks and test scenarios that evaluate agentic workflows and multi-step task performance, including tool-use, task completion, and reliability metrics.
• Evaluation Dataset Development: Curate, validate, and version evaluation datasets and test scenarios, including any adversarial or edge-case sets needed to stress agent behavior.
• Metrics, Analysis, and Reporting: Produce scoring frameworks, visualizations, and written analyses that translate raw evaluation results into actionable findings for stakeholders.

Clearance
A current Top-Secret/SCI with polygraph security clearance is required. Candidates cannot be sponsored or nominated for a government security clearance under this position.

Experience
Seven (7) years' experience as a SWE in programs and contracts of similar scope, type, and complexity is required. Bachelor’s degree in Computer Science or related discipline from an accredited college or university is required. Four additional (4) years of SWE experience on projects with similar software processes may be substituted for a bachelor’s degree.
​
Required skills:

• InspectAI
• Python
• MongoDB
• Jupyter notebooks
• Data visualization tools
• Statistical analysis
• Data cleaning and validation
• Cloud or containerized environments
• Git-based version control
• Collaboration tools such as Jira or Confluence
• Experience operating in airgapped or constrained environments

Benefits
Erias Ventures provides a complete package of wealth, health, and happiness benefits. The expected salary range for this position, depending on education and years of experience is $210,000 - $230,000.

Wealth Benefits:

• Above Market Hourly Pay 
• 11% Roth or Traditional 401k with Immediate Vesting and Deposit
• Spot Bonuses for Assisting with Business Development and Company Growth
• Professional Development Bonuses for Certificates and Degrees

Health Benefits:

• Company subsidized Medical Coverage
• 100% Company Paid Vision and Dental Coverage
• 100% Company Paid Long Term Disability, Short Term Disability, and Group Life Insurance
• Monthly Wellness Reimbursement

Happiness Benefits:

• Paid Time Off with Flexible Work Schedules and Birthday Off
• Amazon Prime Membership and Monthly Internet Reimbursement
• Technology and Productivity Allowance for Equipment and Supplies
• Morale Building and Company Events to Celebrate our Successes and Build our Community
• Onboarding and Annual Swag
• Company Paid Professional Development and Training

At Erias Ventures, we are dedicated to fostering a diverse and inclusive workplace. As an equal opportunity employer, we ensure that all qualified applicants are considered for employment based on merit, without discrimination. We welcome individuals regardless of race, color, religion, gender, gender identity or expression,