worker-vllm

owen/worker-vllm

Fork 0

Commit Graph

Select branches

Hide Pull Requests

main

0.1.0

0.2.0

0.2.1

0.2.2

0.2.3

0.3.0

0.3.1

0.3.2

1.0.0

1.0.1

v.2.15.0

v.2.16.0

v.2.2.1

v1.1

v1.2.0

v1.3.0

v1.3.1

v1.4.0

v1.5.0

v1.6.0

v1.7.0

v1.8.0

v1.9.0

v2.1.0

v2.10.0

v2.11.0

v2.11.1

v2.11.2

v2.11.3

v2.12.0

v2.12.1

v2.12.2

v2.12.3

v2.13.0

v2.13.1

v2.14.0

v2.17.0

v2.18.0

v2.18.1

v2.19.0

v2.19.1

v2.19.2

v2.2.0

v2.2.2

v2.20.0

v2.20.1

v2.21.1

v2.22.0

v2.22.1

v2.22.2

v2.22.3

v2.22.4

v2.22.5

v2.23.0

v2.3.0

v2.3.1

v2.3.2

v2.4.0

v2.5.0

v2.5.1

v2.6.0

v2.8.0

v2.9.0

v2.9.1

v2.9.2

v2.9.3

v2.9.4

v2.9.5

v2.9.6

dc4ad7ddeb fix: kv_transfer_config is dataclass not json, fix for env var velaraptor-runpod 2026-04-09 14:33:11 -05:00
9035b0e07f fix: lmcache version velaraptor-runpod 2026-04-09 14:32:19 -05:00
c979f0020f update readmes on TRANSFORMERS_VERSION velaraptor-runpod 2026-04-06 16:54:08 -05:00
6fbd480a26 fix: allow for transformers_version velaraptor-runpod 2026-04-06 16:49:32 -05:00
3ef1fb8e7b requested changes velaraptor-runpod 2026-04-03 15:53:40 -05:00
08c6ff7490 Bump vLLM to 0.17.0 main Owen Qwen 2026-03-26 12:13:42 -05:00
30e8514d63 Runpod not RunPod velaraptor-runpod 2026-03-17 20:59:52 -05:00
d9808815ee feat: update requirements.txt velaraptor-runpod 2026-03-17 19:56:39 -05:00
d8ed3b5353 feat: update 0.16.0, add lmcache velaraptor-runpod 2026-03-17 19:54:11 -05:00
4c4e039565 feat: add messages route for anthropic/claude velaraptor-runpod 2026-03-17 19:51:50 -05:00
9d1686960d Merge pull request #273 from runpod-workers/bug/hf-overides-rope-scaling chrisvelaandGitHub 2026-03-10 11:21:44 -05:00
45d1eeee47 bug: fix rope scaling to be forward compatible from hf_overrides velaraptor-runpod 2026-03-06 15:34:11 -06:00
17efb0e7d0 Merge pull request #272 from runpod-workers/feat/vllm-0.16.0 v2.14.0 chrisvelaandGitHub 2026-03-05 13:06:45 -06:00
2b5f07df63 feat: Update to 0.16.0, remove NUM_GPU_BLOCKS_OVERRIDE in hub default since 0 will break velaraptor-runpod 2026-03-04 16:38:40 -06:00
13fa71878e Merge pull request #269 from runpod-workers/feat/allow-engine-args-env v2.13.1 chrisvelaandGitHub 2026-02-27 15:34:23 -06:00
8a9365bed4 remove DEFAULT_ARGS that are none, fix MAX_CONTEXT_LEN_TO_CAPTURE velaraptor-runpod 2026-02-27 14:04:15 -06:00
cd485a1af1 update readme velaraptor-runpod 2026-02-25 22:57:17 -06:00
b9043639e9 requested changes/refactor velaraptor-runpod 2026-02-25 16:07:38 -06:00
407dbd7773 Merge pull request #270 from runpod-workers/feat/update-vllm-v0.15.1 chrisvelaandGitHub 2026-02-25 15:35:58 -06:00
f103c142c1 feat: update vllm to 0.15.1 velaraptor-runpod 2026-02-24 17:44:49 -06:00
efb093e198 add as VLLM_RUNPOD prefix and update readme velaraptor-runpod 2026-02-24 17:37:57 -06:00
42443f735e feat: allow engine args through VLLM_ and checks the engine args velaraptor-runpod 2026-02-24 16:05:18 -06:00
b7c6d4f9a2 feat: update dockerfile to 12.9.1 (#267) v2.13.0 chrisvelaandGitHub 2026-02-19 03:13:14 -06:00
d69cc021e8 Merge pull request #268 from runpod-workers/fix/spec-config-0-to-none v2.12.3 chrisvelaandGitHub 2026-02-18 15:51:51 -06:00
61faa8f137 fix: spec config env vars should be none if zero velaraptor-runpod 2026-02-18 15:41:19 -06:00
1606cff557 Merge pull request #265 from runpod-workers/fix/zero-max-model-num_batches v2.12.2 chrisvelaandGitHub 2026-02-13 15:26:06 -06:00
e705c9494b fix: check for zero param and set to None velaraptor-runpod 2026-02-13 15:23:54 -06:00
b749aa5718 Merge pull request #264 from runpod-workers/fix/max_num_batched_tokens v2.12.1 chrisvelaandGitHub 2026-02-13 12:38:01 -06:00
4705ba8a7c fix: check max_num_batched_tokenz if max_model_len not set velaraptor-runpod 2026-02-13 03:29:52 -06:00
767c66c301 make minimal changes velaraptor-runpod 2026-02-13 03:23:44 -06:00
fefdbe21a9 update changes velaraptor-runpod 2026-02-13 03:16:43 -06:00
ee961ad28d Update hub.json velaraptor-runpod 2026-02-13 03:08:19 -06:00
2e8c251447 Merge branch 'main' into feat/update-vllm-v0.15.0 velaraptor-runpod 2026-02-13 03:01:05 -06:00
c3cf43b228 Update hub.json velaraptor-runpod 2026-02-13 00:22:16 -06:00
7ec10b98cd Update utils.py velaraptor-runpod 2026-02-12 15:28:31 -06:00
c45ac42acd vLLM Worker v0.15.0 — Upgrade from v0.11.x to v0.15.0 (#259) v2.12.0
MadiatorLabs GitHub Dj Isaac chrisvela
2026-02-12 21:50:34 +01:00
340bc0b3c6 fix: served model name velaraptor-runpod 2026-02-10 21:42:58 -06:00
e1e9ef74ad add changes from pr velaraptor-runpod 2026-02-06 18:10:09 -06:00
461f89cea6 add torch-c-dlpack-ext requirement velaraptor-runpod 2026-02-06 17:03:39 -06:00
8eb55b90c1 add changes for v0.15.0 velaraptor-runpod 2026-02-05 17:24:16 -06:00
6d6cbe7095 fix: deactivate RunPod tests to fix hub release (#253) v2.11.3 Tim PietruskyandGitHub 2026-01-22 18:06:36 +01:00
90c16b472d fix: update CUDA to 12.4.1 for Blackwell GPU support (#251) v2.11.2
Tim Pietrusky GitHub Claude Opus 4.5
2026-01-13 22:01:36 +01:00
6f2381a9a1 chore(deps): update runpod to latest version (#242) v2.11.1 Tim PietruskyandGitHub 2025-11-24 16:42:21 +01:00
3851d53f93 add ENABLE_EXPERT_PARALLEL engine arg for MoE models (#239) v2.11.0 chrisvelaandGitHub 2025-11-17 12:25:19 -06:00
c896438f21 feat: bump transformers to allow Qwen3-VL (#225) v2.10.0 Witold WydmańskiandGitHub 2025-11-14 17:23:34 +01:00
912892f94e fix: remove space from gpuIds (#234) Tim PietruskyandGitHub 2025-11-14 17:23:09 +01:00
f8bf82469c fix(config): update allowed cuda versions in hub and tests config (#236) Tim PietruskyandGitHub 2025-11-14 17:22:43 +01:00
ec1664902b Merge pull request #230 from runpod-workers/feat/cse-853-vllm-template-params Hailong YangandGitHub 2025-10-31 13:32:34 -04:00
d09122de4a remove un-needed Eugene Klitenik 2025-10-29 13:06:33 -04:00
e27dc68dea remove uneeded Eugene Klitenik 2025-10-29 13:05:26 -04:00
1ee18d06a9 determine num gpus in python Eugene Klitenik 2025-10-29 11:31:42 -04:00
5c4edd15cc update entrypoint command Eugene Klitenik 2025-10-28 18:07:18 -04:00
b074d3a23b auto detect num GPUs Eugene Klitenik 2025-10-28 14:39:55 -04:00
205847471c reduce default container disk size to 150GB Eugene Klitenik 2025-10-28 13:38:16 -04:00
6337a6673a fix: allow also CUDA 12.8 & 12.9 (#228) v2.9.6 Tim PietruskyandGitHub 2025-10-24 18:48:26 +02:00
66e1b1605b Merge pull request #226 from runpod-workers/fix/cse-839-max-concurrency v2.9.5 Tim PietruskyandGitHub 2025-10-22 22:54:21 +02:00
60c8f257a8 Merge pull request #227 from runpod-workers/chore/vllm-0.11.0 Tim PietruskyandGitHub 2025-10-22 22:53:51 +02:00
fae16e7ee1 chore: update vllm to 0.11.0 Tim Pietrusky 2025-10-22 13:40:53 -07:00
2becd35345 Revert "fix: added back the HF_TOKEN (#219)" v2.9.4 max4c 2025-09-23 12:38:24 -07:00
33d88df6c0 fix: added back the HF_TOKEN (#219) v2.9.3
NERDDISCO GitHub Tim Pietrusky
2025-09-23 19:25:12 +02:00
ecd562e112 fix: remove "access token" as this is handled by the platform v2.9.2 Tim Pietrusky 2025-09-19 21:00:47 +02:00
5cffaab8e8 docs: how to use the reasoning parser (#218)
NERDDISCO GitHub Tim Pietrusky
2025-09-17 07:49:37 +02:00
a0fe1dfdad feat: better hub support & concise README for the main repo (#215) v2.9.1
NERDDISCO GitHub Tim Pietrusky
2025-09-01 16:47:48 +02:00
0e0d6df859 docs: updated example-tag for dev and release Tim Pietrusky 2025-08-28 14:28:19 +02:00
d1718aec00 ci: removed "github release" step as that is not needed Tim Pietrusky 2025-08-28 14:27:50 +02:00
5f0fc69d75 feat: prepare worker-vllm for the hub (#214) v2.9.0
NERDDISCO GitHub Tim Pietrusky
2025-08-28 10:09:27 +02:00
aef1187a30 Merge pull request #211 from runpod-workers/fix/allow-none-as-string Marut PandyaandGitHub 2025-08-21 11:35:54 -07:00
f7514dea4b refactor: moved MODEL_NAME & HF_TOKEN out of advanced into the top section Tim Pietrusky 2025-08-18 16:05:43 +02:00
121a3dd44b fix: parse value for RAW_OPENAI_OUTPUT correctly Tim Pietrusky 2025-08-13 12:20:44 +02:00
e2e111b942 fix: allow "None" as string for setting env variables (like quantization) Tim Pietrusky 2025-08-13 10:27:00 +02:00
7aa17463d3 Merge pull request #200 from runpod-workers/release/0.10.0 v2.8.0 Marut PandyaandGitHub 2025-08-11 15:33:51 -07:00
72a643dd0c Merge pull request #207 from JhennerTigreros/main Marut PandyaandGitHub 2025-08-09 09:08:19 -07:00
15f569f970 Merge pull request #208 from runpod-workers/revert-202-feat/proper-deployment Marut PandyaandGitHub 2025-08-09 09:06:53 -07:00
2f2bd4c749 Revert "feat: added dev & release workflows; added conventions to support AI IDE" Marut PandyaandGitHub 2025-08-09 09:01:52 -07:00
fb0c030797 fix initialization on openaiservingmodels Jhenner Tigreros 2025-08-07 16:40:06 -05:00
8b02a703b4 fix issues Jhenner Tigreros 2025-08-07 15:59:43 -05:00
d8863139d6 add model to test Jhenner Tigreros 2025-08-07 15:28:02 -05:00
f5a063956e Fix requirements.txt to support gpt-oss models Jhenner TigrerosandGitHub 2025-08-07 15:13:37 -05:00
18748fd73e Merge pull request #202 from runpod-workers/feat/proper-deployment Marut PandyaandGitHub 2025-08-04 17:13:47 -07:00
0133c23be8 ci: added manual workflow trigger for releases Tim Pietrusky 2025-08-04 09:58:23 +02:00
a129cff47d docs: use "version" instead of actual version, so that people can check the releases Tim Pietrusky 2025-07-31 12:03:17 +02:00
30f2c4630e refactor: use correct version Tim Pietrusky 2025-07-31 12:02:46 +02:00
b98636e432 feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed Tim Pietrusky 2025-07-28 16:40:20 +02:00
185205c750 chore(release): 0.10.0 pandyamarut 2025-07-25 10:18:06 -07:00
b948e530a1 chore(release): 0.10.0 pandyamarut 2025-07-25 10:17:50 -07:00
4f22d6f107 Merge pull request #193 from runpod-workers/release/0.9.1 Marut PandyaandGitHub 2025-06-26 13:23:33 -07:00
8839689132 chore(release): v0.9.1 pandyamarut 2025-06-26 11:06:23 -07:00
5ddc2326cd Merge pull request #191 from runpod-workers/feat/0.9.1 Marut PandyaandGitHub 2025-06-26 10:17:54 -07:00
46a3300cbb chore: reverted changeds to only focus on vllm update Tim Pietrusky 2025-06-20 14:56:39 +02:00
1e9a731380 Fix Mistral tokenizer initialization: let vLLM handle tokenizer for mistral models Tim Pietrusky 2025-06-14 15:31:56 +02:00
c47e649a24 Add CONFIG_FORMAT environment variable support Tim Pietrusky 2025-06-14 15:12:46 +02:00
7192bcaeef Trigger build automatically on feat/0.9.1 branch Tim Pietrusky 2025-06-14 13:49:22 +02:00
8665ffb78d Revert workflow back to original configuration Tim Pietrusky 2025-06-14 13:47:16 +02:00
57431b30ad Fix workflow: use standard GitHub runners and actions Tim Pietrusky 2025-06-14 13:42:46 +02:00
437a84c77a ci: added workflow to build the image Tim Pietrusky 2025-06-14 13:31:36 +02:00
a4062fc488 feat: update to 0.9.1 Tim Pietrusky 2025-06-14 13:31:27 +02:00
9631407c1d Merge pull request #189 from runpod-workers/hf-mm Marut PandyaandGitHub 2025-06-10 17:03:18 -07:00
1a93932ab2 add multi modal env var pandyamarut 2025-06-10 17:02:42 -07:00
4c6c88c3b9 Merge pull request #188 from WorstDev01/add-mm-limit-parameter Marut PandyaandGitHub 2025-06-10 14:59:21 -07:00
a58a76783d Add multimodal limit parameter support WorstDev01 2025-06-10 23:36:47 +02:00

1 2 3 4 5 ...