shelf.cafe
top new
submit Sign in

The compiled run had a lower request-latency sum. I still could not claim break-even.

0

Siddhant Khare · 1mo · discuss

A compiled vLLM run had a lower observed complete-response latency sum across 12 requests, but cold-start debt and different outputs ruled out a break-even claim.

Sign in
shelf.cafe - just a place to share interesting blog posts and articles.
about

We can't find the internet

Attempting to reconnect

Something went wrong!

Attempting to reconnect