9 Pull requests merged by 6 people

• feat: add cleanup for kubernetes dev env

  #59 merged Apr 24, 2025

• Add max score picker

  #51 merged Apr 24, 2025

• Makefile target setting prod and dev versions to the same value

  #55 merged Apr 24, 2025

• fix: Correct the setup of the KGateway Envoy service to be a proper NodePort service

  #57 merged Apr 24, 2025

• tweak instructions for accessing inference service on kind cluster

  #56 merged Apr 24, 2025

• test: Scorers test with dummy scorer and picker

  #53 merged Apr 24, 2025

• Add Kubernetes dev environment deployments with KGateway

  #50 merged Apr 24, 2025

• Merging upstream main commits

  #47 merged Apr 23, 2025

• provide more defaults in Makefile

  #46 merged Apr 22, 2025

6 Pull requests opened by 4 people

• Add scorer based on active loras

  #43 opened Apr 22, 2025

• Prefix Aware Scorer

  #48 opened Apr 23, 2025

• Session affinity scorer

  #52 opened Apr 24, 2025

• Report lint errors on new code only

  #54 opened Apr 24, 2025

• Minor fixes in instructions for deploying dev k8s env

  #58 opened Apr 24, 2025

• feat: Add scripts for kubernetes dev env using vLLM and vLLM-p2p

  #60 opened Apr 25, 2025

2 Issues opened by 1 person

• Endpoint Picker logger not showing traces

  #45 opened Apr 22, 2025

• Prefix Aware Routing

  #42 opened Apr 22, 2025

3 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Implemented KVCacheAwareScorer

  #34 commented on Apr 24, 2025 • 7 new comments

• Add second vLLM-sim instance to allow for routing

  #41 commented on Apr 23, 2025 • 5 new comments

• Fix in scorer manager in picking the best target

  #35 commented on Apr 23, 2025 • 1 new comment