LLM serving capacity planner: VRAM, KV cache, GPU topology, latency, and cost.
Free
One server, in data science & ml. LLM serving capacity planner: VRAM, KV cache, GPU topology, latency, and cost.
Data Science & ML
LLM serving capacity planner: VRAM, KV cache, GPU topology, latency, and cost.
The rest either hold an API key issued by the publisher or ask for nothing.
Listed without a verification tick. Read the listing before installing.