From Fragmented Knowledge to Orchestrated Intelligence:

A Multi-Agent Transformation

CLIENT

Eli Lilly

Pharmaceutical

Strategy

RESPONSIBILITIES

Strategy

Conversation Design

Research

Orchestration

ROLE

AI Integration & Strategy Lead

SOFTWARE

TEAM

Conversation Designer

Product Owner

Data Scientist

Security Stakeholder

The System Problem

After multiple HR platform rollouts and IT system migrations, Lilly’s knowledge environment had fractured

Trigger: During benefits enrollment season, confusion peaked as employees received conflicting policy guidance. This created compliance exposure and employee frustration—escalating the issue to the Csuite

Orchestrated Intelligence

Orchestrated Intelligence

Orchestrated Intelligence

Orchestrated Intelligence

Why Now?

The urgency was undeniable:

Hybrid work expansion made self-service mission-critical

Compliance audits revealed risks from inconsistent policy disseminatio

Retention pressures raised the cost of bad employee experience

Executives recognized fragmented knowledge as both a strategic liability and a compliance threat

The mandate: solve knowledge fragmentation or risk penalties, attrition, and loss of trust.

The Orchestration Strategy

Previous fixes had failed: unified search engines, centralizing SharePoint content, or deploying a single chatbot. They couldn’t resolve conflicts or enforce compliance in real time.

Our orchestration approach:

Agent Registry: Core quartet Listener → Retriever → Policy Sentinel → Content Coach — handled 80% of queries; specialized agents (Evaluator, Audit Logger, Escalation) covered edge case

Governance Layer: conflict resolution hierarchy → Compliance > Brand > Brevit

Observability: audit-ready lineage of every answer (input → prompt → source → approvalr

Feedback Loops: conversation analytics feeding prompt and policy update

Rollout Plan: shadow mode → assist mode → controlled automation

Vendor Role: Partnered with OneReach (orchestration platform vendor) while I owned the system strategy, governance design, and enterprise adoption roadmap.

The Human Impact

This wasn’t just technical; it reshaped experience

Employee search time: PTO lookup dropped from 15 minutes → 2 minute

Agent confidence

For the first time, I feel confident I'm saying the right thing about FMLA without checking three different docs. Service Desk Agenu

Leadership trust: Audit-ready lineage shortened approval cycles and reduced compliance anxiety

Vendor Role: Partnered with OneReach (orchestration platform vendor) while I owned the system strategy, governance design, and enterprise adoption roadmap.

The Transformation Results

Scale: Served 15,000+ employees, handling ~2,000 queries daily across 300+ policy documents

Business outcome: ~15% reduction in HR service costs

Lessons from Friction

Transformation is never clean:

Resistance from content owners:

Fear of losing control. Solved by reframing them as orchestration designers instead of reviewers

Rollout misstep:

Rushed from shadow to assist mode too quickly, eroding trust in one pilot. Slowing the transition restored adoption·

Technical constraint:

Legacy HRIS lacked APIs. Built intelligent extraction layers to monitor changes and auto-update the knowledge graph.

Takeaway: Governance isn t a gate—it s a compass. Success depended as much on cultural alignment as technical architecture.

Strategic Choices

This was AI strategy, not just information architecture:

Modeling: Selected smaller, specialized models over giant LLMs to minimize hallucinations, improve latency, and win compliance approval

Modeling: Selected smaller, specialized models over giant LLMs to minimize hallucinations, improve latency, and win compliance approval

Modeling: Selected smaller, specialized models over giant LLMs to minimize hallucinations, improve latency, and win compliance approval

Modeling: Selected smaller, specialized models over giant LLMs to minimize hallucinations, improve latency, and win compliance approval

Competitive evaluation: Assessed ServiceNow and others, but none could handle real-time policy conflict resolution at scalò

Competitive evaluation: Assessed ServiceNow and others, but none could handle real-time policy conflict resolution at scalò

Competitive evaluation: Assessed ServiceNow and others, but none could handle real-time policy conflict resolution at scalò

Competitive evaluation: Assessed ServiceNow and others, but none could handle real-time policy conflict resolution at scalò

Team leadership: Directed a cross-functional team of 8, aligned C-suite stakeholders, and drove adoption with OneReach as platform partner

Team leadership: Directed a cross-functional team of 8, aligned C-suite stakeholders, and drove adoption with OneReach as platform partner

Team leadership: Directed a cross-functional team of 8, aligned C-suite stakeholders, and drove adoption with OneReach as platform partner

Team leadership: Directed a cross-functional team of 8, aligned C-suite stakeholders, and drove adoption with OneReach as platform partner

Traditional IA organizes static content. Our AI strategy orchestrated dynamic, conflicting knowledge sources with real-time governance and self-improving feedback loops.

The Models Portability

This architecture solves a specific class of problems: regulated knowledge at scale where conflicts and compliance are unavoidable.

Applicable domains

HR policies (benefits, leave, compliancer

Financial services (retirement guidance, disclosuresr

Healthcare (clinical protocols, patient guidance)

The transferable pattern: parallel agents + conflict resolution hierarchy + governance-by-design.

Key Takeaways

The breakthrough wasn’t better AI.

It was realizing that knowledge behaves more like a supply chain than a library.

Libraries need better searchu

Libraries need better searchu

Supply chains need orchestration.

Supply chains need orchestration.

Next evolution: Predictive orchestration agents that detect policy conflicts upstream and propose harmonization before deployment

Next Project

Next Project

Next Project

Next Project

INFINITE ATHLETE