Jobs and Careers

IT Software Engineer

United StatesRemotefull_timeVerifiedPosted 18 Aug 2026

About the role

At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer you the ultimate career opportunity that will light a fire within you.

IT Software Engineer, Core AI Development

So, what’s the role all about?

NICE is assembling a core engineering team to build the internal AI platform that powers intelligent automation across the enterprise. As IT Software Engineer in the Orchestration AI Development team, you will move beyond using AI tools, you will build them.

You will implement the foundational components of NICE's AI architecture: the integration layer that connects enterprise systems via MCP, the agent orchestration engine, the Models Gateway, RAG pipelines, and the tooling that makes every developer at NICE more productive. Your work ships to production and is used daily by hundreds of colleagues.

This is a full-stack engineering role with a strong AI focus. You will write clean, production-quality code, collaborate closely with the Software Architect and DevOps teams, and operate with significant autonomy on technically complex problems.

How will you make an impact?

You will own and build the core components of NICE's AI platform, the integration layer, agent platform, Models Gateway, RAG pipelines, and developer tooling, working hands-on across the stack with the Architect, DevOps, and Security teams.

Build the MCP Integration Layer

• Implement MCP server and client libraries that connect enterprise systems (Atlassian, Microsoft 365, ServiceNow, Workday, Salesforce, Snowflake) to AI agents

• Design and expose clean tool schemas; handle auth flows (OAuth2, managed identity); implement error handling, retries, and rate limiting

• Build the A2A (Agent-to-Agent) interoperability layer enabling multi-agent collaboration across the platform

Develop the AI Agentic Platform

• Implement production-grade AI agent frameworks: ReAct loops, tool-augmented reasoning, multi-agent orchestration, memory and state management

• Build agent harnesses for specific NICE use cases: IT helpdesk automation, procurement workflows, HR self-service, developer productivity agents

• Integrate with Azure AI Foundry and Anthropic Claude API, managing context windows, tool use, streaming responses, and multi-turn conversations

Engineer the Models Gateway

• Build a unified gateway abstracting multiple LLM providers (Azure OpenAI, Anthropic, open-source models via Azure ML)

• Implement model routing logic, fallback chains, cost-based dispatch, latency budgeting, and per-team quota enforcement

• Add logging, token metering, and usage dashboards for FinOps visibility

Build RAG Pipelines & Vector Infrastructure

• Design and implement document ingestion pipelines: chunking, embedding generation, metadata enrichment, and upsert into vector stores

• Build retrieval pipelines with hybrid search (dense + sparse), re-ranking, and context assembly for LLM prompts

• Manage vector DB infrastructure on Azure AI Search and/other; own schema design and index optimization

Implement Prompt Management & LLM Evals

• Build a prompt registry: version control, templating engine, environment promotion, and rollback

• Design and run LLM evaluation pipelines: automated regression tests, hallucination detection, task-specific benchmarks

• Implement human-in-the-loop feedback collection and model performance tracking dashboards

Contribute to Developer Tooling & CI/CD

• Build and

Apply for this role

Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

Apply Now →Generate Application Kit

Free account required — sign up in 30s

Company

NICE

View company profile →

Similar roles

Membership Manager- Fitness Sales

StretchLab

Windsor

Xfinity Retail Service Associate

Comcast

Naples

$32,000/yr

Digital Division Intern

INSURICA

Norman

$30,000/yr