owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
484 Commits 1 Branch 69 Tags
61faa8f137cb46b3917e6d7207c68ae08a247703
Commit Graph
8 Commits
Author SHA1 Message Date
velaraptor-runpod 767c66c301 make minimal changes 2026-02-13 03:23:44 -06:00
velaraptor-runpod 2e8c251447 Merge branch 'main' into feat/update-vllm-v0.15.0 2026-02-13 03:01:05 -06:00
MadiatorLabsGitHubDj Isaacchrisvela
 		c45ac42acd vLLM Worker v0.15.0 — Upgrade from v0.11.x to v0.15.0 (#259)
Release / release (push) Waiting to run 
* VLLM upgrade to 0.12.0 and compatibility fixes

* MAX_NUM_BATCHED_TOKENS fix and CUDA tester

* Sys kill worker instead of marking as failed

* upgrade to vllm 0.12.0

* Update to vllm 0.15.0 and lora fix

* Update for HUB and removal of deprected env variables

* reverted docker-bake changes

* removed leftovers

* Update src/handler.py

Co-authored-by: Dj Isaac <contact@dejaydev.com>

* Update src/utils.py

Co-authored-by: Dj Isaac <contact@dejaydev.com>

* Update src/handler.py

Co-authored-by: Dj Isaac <contact@dejaydev.com>

* Clean up of docs and comments in code

* nit: lowercase p

* nit: lowercase p

---------

Co-authored-by: Dj Isaac <contact@dejaydev.com>
Co-authored-by: chrisvela <chris.vela@runpod.io>
 2026-02-12 21:50:34 +01:00
velaraptor-runpod e1e9ef74ad add changes from pr 2026-02-06 18:10:09 -06:00
chrisvelaandGitHub 3851d53f93 add ENABLE_EXPERT_PARALLEL engine arg for MoE models (#239)
Release / release (push) Waiting to run 
* enable expert parallel arg for moe models

* add ENABLE_EXPERT_PARALLEL to hub config
 2025-11-17 19:25:19 +01:00
Tim PietruskyandGitHub 66e1b1605b Merge pull request #226 from runpod-workers/fix/cse-839-max-concurrency
Release / release (push) Waiting to run 
fix: max concurrency = 30 instead of 300
 2025-10-22 22:54:21 +02:00
NERDDISCOGitHubTim Pietrusky
 		5cffaab8e8 docs: how to use the reasoning parser (#218) 
Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-09-17 07:49:37 +02:00
NERDDISCOGitHubTim Pietrusky
 		a0fe1dfdad feat: better hub support & concise README for the main repo (#215)
Release / release (push) Waiting to run 
* feat: moved config into docs; added banner; auto detect "messages" in input

* docs: moved config into docs

* chore: added .DS_Store

* chore: get the original stuff working again

* chore: remove all changes

* docs: reduced toc and added small config table

---------

Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-09-01 16:47:48 +02:00