• vLLM Worker v0.15.0 — Upgrade from v0.11.x to v0.15.0 (#259)

    owen released this 2026-02-12 15:50:34 -05:00

    • VLLM upgrade to 0.12.0 and compatibility fixes

    • MAX_NUM_BATCHED_TOKENS fix and CUDA tester

    • Sys kill worker instead of marking as failed

    • upgrade to vllm 0.12.0

    • Update to vllm 0.15.0 and lora fix

    • Update for HUB and removal of deprected env variables

    • reverted docker-bake changes

    • removed leftovers

    • Update src/handler.py

    Co-authored-by: Dj Isaac contact@dejaydev.com

    • Update src/utils.py

    Co-authored-by: Dj Isaac contact@dejaydev.com

    • Update src/handler.py

    Co-authored-by: Dj Isaac contact@dejaydev.com

    • Clean up of docs and comments in code

    • nit: lowercase p

    • nit: lowercase p


    Co-authored-by: Dj Isaac contact@dejaydev.com
    Co-authored-by: chrisvela chris.vela@runpod.io

    Downloads