Senior RAG Engineer

Overview

At Wipfli, people count.

 

At Wipfli, our people are core to everything we do—the catalyst behind our ability to create exceptional impact and extraordinary results.

 

We believe in flexibility. We focus on relationships. We encourage each individual to follow their own path.

 

People truly matter and they feel it. For those looking to make a difference and find a professional home, Wipfli offers a career-defining opportunity.

 

Job Summary

Wipfli is building the next generation of AI‑powered solutions that transform how our professionals deliver value to clients. As a Senior RAG Engineer, you will play a pivotal role in advancing our AI‑driven functional requirements documentation platform, an enterprise application used across the firm to automate the creation of complex project documentation.

 

This role blends software engineering, machine learning, and enterprise application development. You’ll work closely with data scientists, engineers, and business teams to build production‑grade retrieval and generation systems that make a measurable impact on hundreds of users.

 

If you’re passionate about building real AI products, not demos or POCs, and you want to shape the foundation of a growing AI capability, this is your opportunity.

Responsibilities

Responsibilities:

• Design, develop, and optimize full‑stack applications using RAG for high‑accuracy retrieval and generation
• Build and maintain APIs and microservices with monitoring and logging for reliability and performance
• Implement vector databases and semantic search; fine‑tune retrieval for strong precision and recall
• Optimize chunking, embeddings, and retrieval parameters tailored to professional services content
• Evaluate LLM architectures and maintain prompt‑engineering frameworks to improve response quality
• Build ETL pipelines and integrate with firm platforms such as document management, CRM, and engagement systems
• Ensure data quality, security, and compliance, including role‑based access, encryption, audit logging, and confidentiality
• Partner across teams—engagement, data science, and ML—to deliver capabilities and mentor junior engineers
• Stay current on emerging AI/ML technologies and assess applicability to enterprise use cases

 

Knowledge, Skills and Abilities

Required Qualifications:

• Bachelor's degree in Computer Science, Information Management, Data Science, or AI related field 
• 3-5 years of experience in data science and AI roles 
• 7-10 years of experience software development roles 
• Demonstrated track record of building production-grade AI applications from conception to deployment
• Demonstrated deep understanding of RAG methodologies and practical application. Experience with frameworks such as LangChain, LlamaIndex, or Haystack is considered an additional asset 
• Experience with document processing and OCR technologies, including integration and deployment within enterprise environments 

Preferred Qualifications:

• Master's degree or advanced certification in Data Science or AI
• 4+ years of full stack development experience with modern frameworks (React, Vue, or Angular; Node.js, Python, or similar; .NET experience

Benjamin Dzanic, from our recruiting team, will be guiding you through this process. Visit his LinkedIn page to connect! 

 

#LI-REMOTE #LI-BD1

Additional Details

Additional Details:

 

Wipfli is an equal opportunity/affirmative action employer. All candidates will receive consideration for employment without regards to race, creed, color, religion, national origin, sex, age, marital status, sexual orientation, gender identify, veteran status, disability, or any other characteristics protected by federal, state, or local laws. 

 

Wipfli is committed to providing reasonable accommodations for people with disabilities. If you require a reasonable accommodation to complete an application, interview, or participate in our recruiting process, please send us an email at hr@wipfli.com  

 

Wipfli values fair, transparent, and competitive compensation, considering each candidate's unique skills and experiences. The estimated base pay range for this role is $106,600 to $160,000, with offers typically not made at the maximum, allowing for future salary increases. The actual salary at the time of offer depends on business related factors like location, skills, experience, training/education, licensure, certifications, business needs, current associate pay, and relevant employment laws. 

 

Individuals may be eligible