
From Fragmented Knowledge to Orchestrated Intelligence:
A Multi-Agent Transformation
CLIENT
Eli Lilly
Pharmaceutical
Strategy
RESPONSIBILITIES
Strategy
Conversation Design
Research
Orchestration
ROLE
AI Integration & Strategy Lead
SOFTWARE
TEAM
Conversation Designer
Product Owner
Data Scientist
Security Stakeholder

The System Problem
After multiple HR platform rollouts and IT system migrations, Lilly’s knowledge environment had fractured
Trigger: During benefits enrollment season, confusion peaked as employees received conflicting policy guidance. This created compliance exposure and employee frustration—escalating the issue to the Csuite


Why Now?
The urgency was undeniable:
Hybrid work expansion made self-service mission-critical
Compliance audits revealed risks from inconsistent policy disseminatio
Retention pressures raised the cost of bad employee experience
Executives recognized fragmented knowledge as both a strategic liability and a compliance threat
The mandate: solve knowledge fragmentation or risk penalties, attrition, and loss of trust.

The Orchestration Strategy
Previous fixes had failed: unified search engines, centralizing SharePoint content, or deploying a single chatbot. They couldn’t resolve conflicts or enforce compliance in real time.
Our orchestration approach:
Agent Registry: Core quartet Listener → Retriever → Policy Sentinel → Content Coach — handled 80% of queries; specialized agents (Evaluator, Audit Logger, Escalation) covered edge case
Governance Layer: conflict resolution hierarchy → Compliance > Brand > Brevit
Observability: audit-ready lineage of every answer (input → prompt → source → approvalr
Feedback Loops: conversation analytics feeding prompt and policy update
Rollout Plan: shadow mode → assist mode → controlled automation
Vendor Role: Partnered with OneReach (orchestration platform vendor) while I owned the system strategy, governance design, and enterprise adoption roadmap.

The Human Impact
This wasn’t just technical; it reshaped experience
Employee search time: PTO lookup dropped from 15 minutes → 2 minute
Agent confidence
For the first time, I feel confident I'm saying the right thing about FMLA without checking three different docs. Service Desk Agenu
Leadership trust: Audit-ready lineage shortened approval cycles and reduced compliance anxiety
Vendor Role: Partnered with OneReach (orchestration platform vendor) while I owned the system strategy, governance design, and enterprise adoption roadmap.
The Transformation Results
Scale: Served 15,000+ employees, handling ~2,000 queries daily across 300+ policy documents
Business outcome: ~15% reduction in HR service costs

Lessons from Friction
Transformation is never clean:
Resistance from content owners:
Fear of losing control. Solved by reframing them as orchestration designers instead of reviewers
Rollout misstep:
Rushed from shadow to assist mode too quickly, eroding trust in one pilot. Slowing the transition restored adoption·
Technical constraint:
Legacy HRIS lacked APIs. Built intelligent extraction layers to monitor changes and auto-update the knowledge graph.
Takeaway: Governance isn t a gate—it s a compass. Success depended as much on cultural alignment as technical architecture.

Strategic Choices
This was AI strategy, not just information architecture:
Traditional IA organizes static content. Our AI strategy orchestrated dynamic, conflicting knowledge sources with real-time governance and self-improving feedback loops.

The Models Portability
This architecture solves a specific class of problems: regulated knowledge at scale where conflicts and compliance are unavoidable.
Applicable domains

HR policies (benefits, leave, compliancer

Financial services (retirement guidance, disclosuresr

Healthcare (clinical protocols, patient guidance)
The transferable pattern: parallel agents + conflict resolution hierarchy + governance-by-design.

Key Takeaways
The breakthrough wasn’t better AI.
It was realizing that knowledge behaves more like a supply chain than a library.
Next evolution: Predictive orchestration agents that detect policy conflicts upstream and propose harmonization before deployment