Senior Cloud Automation Engineer - Claims Adjudication

At CVS Health, we’re building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.

As the nation’s leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues – caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all with heart, each and every day.

Role Summary

We are seeking a highly skilled Cloud Automation Engineer to join our team, focusing on building a cutting-edge, cloud-native automation framework hosted on platforms like Azure or GCP.

As part of the team, you will play a crucial role in developing and maintaining automation frameworks that drive the state-of-the-art Pharmacy Services – Claim Processing Application. You will work on integrating cloud-native solutions, enhancing performance, and ensuring seamless operation within a highly scalable and secure environment.

The ideal candidate will have extensive experience in automation framework development, system design, and a strong understanding of cloud-native software engineering principles.

**Preference is for candidates to work hybrid out of our corporate office in Richardson, TX; we may consider remote for the right candidate

What you will do:

API and Integration Testing:

• Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing.

• Conduct rigorous testing of new language models (commercial and open-source) via their APIs, focusing on accuracy, performance, scalability, and cost-effectiveness.

• Validate data integrity and consistency across various API endpoints and integrations.

• Implement and maintain API test automation frameworks and tools.

Automation Development and Execution:

• Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency.

• Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines.

• Champion automation best practices and drive continuous improvement in automation coverage.

• Develop and maintain performance testing scripts for API endpoints and backend services.

AI Model Evaluation Framework Validation:

• Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes.

• Develop automated tests to validate the functionality and performance of the evaluation framework itself.

• Implement automated reporting and analysis of test results.

• Run automated tests against one or multiple language models simultaneously through API interfaces.

Collaboration and Communication:

• Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high-quality AI solutions.

• Clearly communicate technical concepts and testing results to both technical and non-technical stakeholders.

• Continuous Improvement:

• Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hub’s testing processes.

• Continuously evaluate and improve the AI Hub’s quality assurance capabilities, with a focus on automation and efficiency.

Required Qualifications

5+ years of experience in test automation and software quality assurance, with a focus on API testing including the following. ​

• Proven experience designing and implementing automation frameworks using industry-standard tools. ​

• Strong programming skills (Python, Java, etc. ​).

• Experience with cloud testing platforms and methodologies. ​

• Comprehensive understanding of API architecture and Testing framework like Playwright, Cypress​ and similar tools.

• Experience with RESTful, SOAP, GraphQL, or similar API technologies. ​

• Experience with CI/CD tools like GitHub, GitLab CI, Jenkins

Preferred Qualifications

• Ability to lead high performance software development testing teams.

• Familiarity with AI/ML testing principles (beneficial but not primary. ​

• Playwright experience is preferred

• Experience in working both independently as well as part of a cross-functional team