Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

github.com

8 points by sarkory 2 days ago

zexinwu 2 days ago

[dead]