SELLABLE THROUGHPUT
2.5–4×
more sellable tokens vs vLLM
vLLM
OpenInfer
CONCURRENT LOAD →
SELLABLE TOKENS/SEC