Sr Staff Software QA Engineer - Search Platform

Company Description

At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you. 

With more than 7,700+ customers, we serve approximately 85% of the Fortune 500®, and we're proud to be one of FORTUNE 100 Best Companies to Work For® and World's Most Admired Companies™.

Learn more on Life at Now blog and hear from our employees about their experiences working at ServiceNow.

Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.

Job Description

About the team:

The AI Search team at ServiceNow is responsible for developing the search engine deployed as part of the ServiceNow platform.   As a Senior Staff Software QE on the AI Search team, you will play a critical role in the product’s testing and strategy.

Successful team members at ServiceNow have a passion to be a part of, lead, and grow amazing teams. You'll also work cross functionally to deliver high quality software to both internal and external developers and customers.

What you get to do in this role:

• You will work on a team to build/oversee test strategies for all layers of Search platform - UX, Middle layer, Backend, AI/ML capabilities for our product with high scalability and quality in mind.
• Lead and coordinate work cross functionally, developing process and mentoring junior members in the team.
• Design performance test strategy for ingestion, query and various Search features.
• Plan and evaluate quality of Machine Learning / Generative AI pipelines.
• Design and build automation test frameworks and tools.
• Maintain existing automation test frameworks.
• Collect and report quality metrics from test execution.
• Work with developers to design specific testing strategies for features being developed and automate them.
• Create comprehensive test plans; execute and automate them
• Support engineering organizations in troubleshooting or addressing issues with applications and dev/test environments.

Qualifications

To be successful in this role, you have

• 10+ years professional experience in quality assurance or application development
• Advanced knowledge of QE work
• Experience leading quality efforts within a scrum team of 10+ QE engineers
• Ability to diagnose issues, come up with a strategy for relief, permanent fix and RCA and implement it
• Knowledge of Cloud Dev. Platforms, Web Dev, Frameworks, and service-oriented architecture
• Ability to implement best practices and coding standards on role specific requirements (e.g. programming languages and tools, network design, functional design, algorithms, patterns, design and development, etc.)
• Knowledge of open source or commercial search technology such as Lucene, Solr, ElasticSearch, or Attivio.
• Fluency with Java and/or Python, scripting in JavaScript. Experience with jenkins pipeline (Groovy) is a plus
• Experience testing AI/ ML / Relevancy
• Experience with Language Models/ Generative AI is a plus
• Experience writing test automation using Selenium
• Experience with Performance and scalability testing using Jmeter, Web performance tests
• Experience with different testing techniques (e.g. performance, unit, integration, automated), their strengths and weakness, and ability to use them to best effect.
• Expert working knowledge and ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks
• Experience driving cross-team technical discussions with an understanding of SDLC concepts

FD21