owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
473 Commits 1 Branch 69 Tags
7ec10b98cd940df327846dfe89ec6bc58199d5ce
Commit Graph
9 Commits
Author SHA1 Message Date
velaraptor-runpod e1e9ef74ad add changes from pr 2026-02-06 18:10:09 -06:00
chrisvelaandGitHub 3851d53f93 add ENABLE_EXPERT_PARALLEL engine arg for MoE models (#239)
Release / release (push) Waiting to run 
* enable expert parallel arg for moe models

* add ENABLE_EXPERT_PARALLEL to hub config
 2025-11-17 19:25:19 +01:00
Tim PietruskyandGitHub 66e1b1605b Merge pull request #226 from runpod-workers/fix/cse-839-max-concurrency
Release / release (push) Waiting to run 
fix: max concurrency = 30 instead of 300
 2025-10-22 22:54:21 +02:00
NERDDISCOGitHubTim Pietrusky
 		5cffaab8e8 docs: how to use the reasoning parser (#218) 
Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-09-17 07:49:37 +02:00
NERDDISCOGitHubTim Pietrusky
 		a0fe1dfdad feat: better hub support & concise README for the main repo (#215)
Release / release (push) Waiting to run 
* feat: moved config into docs; added banner; auto detect "messages" in input

* docs: moved config into docs

* chore: added .DS_Store

* chore: get the original stuff working again

* chore: remove all changes

* docs: reduced toc and added small config table

---------

Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-09-01 16:47:48 +02:00
NERDDISCOGitHubTim Pietrusky
 		5f0fc69d75 feat: prepare worker-vllm for the hub (#214)
Release / release (push) Waiting to run 
* docs: remove outdated video; remove old info; added missing config for tools

* ci: use proper release for dev (pr only) and production (release only)

* ci(hub): added openai example; use smollm2 as base model

* docs: added conventions to be able to work with ai ide's

* chore: remove outdated stuff

* chore: update copyright to 2025

* ci: added github permissions

* feat: added gpuIds, gputCount and allowedCudaVersions; removed default value for LOAD_FORMAT to check which influence this has on the ui

---------

Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-08-28 10:09:27 +02:00
Marut PandyaandGitHub 2f2bd4c749 Revert "feat: added dev & release workflows; added conventions to support AI IDE" 2025-08-09 09:01:52 -07:00
Tim Pietrusky a129cff47d docs: use "version" instead of actual version, so that people can check the releases 2025-07-31 12:03:17 +02:00
Tim Pietrusky b98636e432 feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed 2025-07-28 16:40:20 +02:00