Code

Implemented KVCacheAwareScorer#34

Code

Open

vMaroon wants to merge 2 commits intoneuralmagic:devneuralmagic/gateway-api-inference-extension:devfrom

vMaroon:kvcache-awarevMaroon/gateway-api-inference-extension:kvcache-awareCopy head branch name to clipboard

Commits

Commits on Apr 24, 2025

• implemented kvcache-aware-scorer

  Show description for 83a91a6
  vMaroon

  committed
  83a91a6

  Copy full SHA for 83a91a6

Commits on Apr 25, 2025

• kvcache-aware-scorer fails on misconfig

  Show description for cbe46d7
  vMaroon

  committed
  cbe46d7

  Copy full SHA for cbe46d7