CPU — host & scheduler
holds the state, owns the frame, decides what runs where
GPU
frontier matmul
accelerator · guest
NPU
offloaded ops
accelerator · guest
Small models
routers · rerankers · guardrails · draft
on the CPU
Orchestration
tools · retrieval · KV state
on the CPU
The accelerators are guests — lit only when the host hands them work. The CPU is always the center.