SELLABLE THROUGHPUT
4–10×
more sellable tokens vs vLLM
vLLM
OpenInfer
CONCURRENT LOAD →
SELLABLE TOKENS/SEC