The temptation when designing a platform is to centralize everything. The right answer is to centralize a small number of things — the ones where uniformity actually matters — and let teams own everything else.
Centralize these
- Eval harness — uniform metrics across the org make decisions comparable
- Tool registry — discoverability + version control of internal tools
- Secrets management — non-negotiable
- Cost reporting + budget alerts — finance needs one truth
- Model gateway — single egress point lets you swap providers and apply rate limits org-wide
Leave these with the teams
- Prompts and system prompts — domain context lives with the team that owns the domain
- Golden eval sets — coverage is local
- Runbooks — on-call ownership is local
- Choice of orchestration framework — let teams pick the wrong one cheaply
Knowledge check
0/1 answered1. Which of these should live in the platform (centralized) layer?
Discussion
0 commentsBe the first to start the conversation.