QA Engineer, AI

We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their full potential. Our exceptional people are the key to our unrivaled, culture and talent experience and our ability to be compelling to our clients. You’ll find an environment that inspires and empowers you to thrive both personally and professionally. There’s no one like you and that’s why there’s nowhere like RSM.

The QA Engineer is accountable to the AI Director for oversight on project planning, reporting, test strategies, test writing and test execution, as it relates to the QA activities on development efforts.  This individual will provide insights into training and be a fundamental part of mentoring other QA personnel and team members from the entire project team on testing approach and methods.  They will apply broad experience, technical skills, and risk analysis to effectively manage testing activities and QA peers on projects. Typically, the Quality Assurance Engineer is assigned to the most challenging assignments, is almost constantly leading medium to large scale projects, and is a primary consultant on how applications work. QA process design and implementation experience will be applied to AI specific solutions, features, and endpoints. Experience in designing and implementing evaluation metrics, machine learning precision and accuracy measures, and developing judges and evaluations for large language models are a responsibility of this position.

Essential Duties

• Represents the QA Team on requests for QA needs and support activities. Delegates work to the team accordingly. Lead all Quality Assurance tasks and processes on their assigned product team’s medium, large, and complex projects to ensure that AI solutions produced are of high quality.  (40% of time)
• Serves as the subject matter expert for support issues on Firm applications, testing strategy and execution. (20% of time)
• Mentor and train QA and other IT personnel on technical skills and QA methods to effectively test applications or processes.  May also be involved with interviewing for new hires within the QA department. (15% of time)
• Identify and execute appropriate communication method to assure project team collaboration and meet program manager, stakeholder and senior leadership needs on the accurate technical status of a project. (15% of time)
• Provide input and guidance to project teams and QA department as a whole on effective use of the Quality Center tool as it relates to release management, test planning, execution, documentation and defect tracking.  Provides input to resource manager and team on training or other testing tools that may also add value to the QA effort.  Responsible for providing effort estimates, recommendations and updates on deadlines to leadership. (5% of time)
• Training, admin, and other duties as assigned (5% of time)

Minimum Qualifications

EDUCATION/CERTIFICATIONS

• Bachelor’s degree preferred in Information Systems or similar work experience in a computer related field

EXPERIENCE

• Minimum of 8 years of QA experience
• Minimum of 5 years of lead QA experience on moderate to large projects
• Experience testing a variety of applications on assorted platforms
• Experience with AI solution evaluation and precision metrics preferred.

TECHNICAL SKILLS

• Proficient in MS Office products
• SME knowledge of Quality Center or other test planning and defect tracking tools
• Strong Microsoft SQL Query skills
• SDLC knowledge
• Thorough understanding of Quality Assurance processes, types of software testing, risk assessment,
• Knowledge of a variety development platforms, such as Peoplesoft, Powerbuilder, .NET, HTML, etc.

SPECIAL REQUIREMENTS OF THE JOB

• Ability to work in a highly collaborative environment and consult effectively with employees at all levels
• Strong aptitude for understanding how an application can be incrementally built in phases to begin testing prior to a complete development effort being turned over to QA.
• General knowledge of business processes, IT network/system structure, and programming concepts
• Strong attention to detail, motivation, and initiative.
• Self starter with the ability to manage multiple tasks and re-prioritize, when necessary.
• Effective organization and time management skills
• Ability to see big picture and understand goals of the business to facilitate best solutions in our application development efforts
• Confidence to stand ground if items are not meeting expected quality standards

LEADERSHIP SKILLS

• High level of emotional maturity that ca