This website requires JavaScript.
76f345be08
Merge pull request #321 from runpod-workers/revert-318-feat/0.24.0
v2.23.0
chrisvela and GitHub
2026-07-24 15:23:50 -05:00
4dfda80fd0
Revert "feat: update to 0.24.0"
chrisvela and GitHub
2026-07-24 15:16:55 -05:00
89f25b0d70
Merge pull request #319 from runpod-workers/runpod-package-update
Dean Quiñanola and GitHub
2026-07-24 12:13:02 -07:00
4808160735
chore: update runpod to 1.11.0
deanq and github-actions[bot]
2026-07-24 18:30:38 +00:00
51e1aee770
Merge pull request #318 from runpod-workers/feat/0.24.0
Dean Quiñanola and GitHub
2026-07-24 11:30:29 -07:00
86b7951c39
feat: update to 0.24.0
velaraptor-runpod
2026-07-16 18:33:38 -05:00
e786204cf5
Merge pull request #316 from runpod-workers/docs/sync-vllm-version-0.23.0
chrisvela and GitHub
2026-07-10 11:10:53 -05:00
591f9d6531
Merge pull request #317 from runpod-workers/fix/test-sls-gh-action
chrisvela and GitHub
2026-07-10 09:55:53 -05:00
49967d0c09
fix: fix image to test with sls in gh actions
velaraptor-runpod
2026-07-09 22:25:40 -05:00
e97cab854f
docs: sync vLLM version to 0.23.0 in READMEs
velaraptor-runpod and github-actions[bot]
2026-07-10 02:18:51 +00:00
828e797498
Merge pull request #315 from runpod-workers/feat/0.23.0
chrisvela and GitHub
2026-07-09 21:18:41 -05:00
373847d9f9
fix: pin models to version, except for gpt-oss
velaraptor-runpod
2026-07-09 19:21:24 -05:00
2000acc0a3
chore: add timeout for e2e serverless
velaraptor-runpod
2026-07-09 19:15:19 -05:00
89e3b2e920
fix: fix for huggingface, secret keys
velaraptor-runpod
2026-07-09 18:56:58 -05:00
85f8c81c1c
add sls e2e tests
velaraptor-runpod
2026-07-09 18:22:57 -05:00
88490e9551
feat: update to 0.23.0
velaraptor-runpod
2026-07-09 18:22:40 -05:00
798f2b12eb
feat: update to 0.23.0
velaraptor-runpod
2026-07-01 16:19:01 -05:00
9e1c483136
Merge pull request #311 from runpod-workers/t3code/cd56c69d
v2.22.5
chrisvela and GitHub
2026-06-26 13:48:13 -05:00
d71ea9939d
Merge pull request #308 from runpod-workers/docs/sync-vllm-version-0.20.2
chrisvela and GitHub
2026-06-26 13:47:59 -05:00
7e2b4e2288
Merge pull request #314 from runpod-workers/runpod-package-update
chrisvela and GitHub
2026-06-26 13:45:16 -05:00
015f8f3c4d
chore: update runpod to 1.10.0
deanq and github-actions[bot]
2026-06-26 17:20:41 +00:00
75ffcf73f2
Merge pull request #309 from adithyaJRunpod/feature/tuned-configs-round2
Hailong Yang and GitHub
2026-06-22 17:41:50 -04:00
d7ba3b6ab7
test: install pyyaml and isolate vllm config file in tests
Tim Pietrusky
2026-06-19 19:05:24 +02:00
b11c91722c
test: complete vllm stub so src.utils imports under py<3.14
Tim Pietrusky
2026-06-19 19:02:49 +02:00
fcdc799e0d
fix: serve original model name when hf cache dir is lowercased (#310 )
Tim Pietrusky
2026-06-19 18:59:05 +02:00
84ec446493
added configs for Gemma 4 31B and GPT-OSS 120B
AdithyaJob
2026-06-17 22:19:58 -07:00
db246653a2
docs: sync vLLM version to 0.20.2 in READMEs
velaraptor-runpod and github-actions[bot]
2026-06-12 20:51:06 +00:00
1b3228a2dc
Merge pull request #307 from runpod-workers/fix/revert-0.20.0
v2.22.4
chrisvela and GitHub
2026-06-12 15:50:52 -05:00
4817d4a8e7
revert to 0.20.2
velaraptor-runpod
2026-06-12 15:49:23 -05:00
0378382a92
Merge pull request #306 from runpod-workers/revert/v2.20.1
v2.22.3
chrisvela and GitHub
2026-06-12 15:21:22 -05:00
08580e7ccf
chore: carry non-vllm changes from main (tests GPU + configs)
velaraptor-runpod and Claude Sonnet 4.6
2026-06-12 15:18:36 -05:00
8868aae6b1
Merge pull request #305 from runpod-workers/fix/typo-tests-l40
v2.22.2
chrisvela and GitHub
2026-06-12 14:00:54 -05:00
fb8adc5c06
fix: fix typo in tests
velaraptor-runpod
2026-06-12 13:59:29 -05:00
7351da512b
Merge pull request #304 from runpod-workers/fix/fix-tests
v2.22.1
chrisvela and GitHub
2026-06-12 13:49:15 -05:00
1e78043b2c
fix: change test gpu to L40
velaraptor-runpod
2026-06-12 13:46:33 -05:00
352c64f4c1
Merge pull request #303 from runpod-workers/chore/check-vllm-versions-readmes
chrisvela and GitHub
2026-06-12 09:49:07 -05:00
0922f5b435
chore: check readmes vllm version in sync with version in Dockerfile
velaraptor-runpod
2026-06-11 17:33:16 -05:00
5d9a48fc70
Merge pull request #302 from runpod-workers/feat/0.22.1
v2.22.0
chrisvela and GitHub
2026-06-11 17:27:38 -05:00
5d1579e361
fix: update readme links
velaraptor-runpod
2026-06-11 17:00:31 -05:00
0488b77d89
feat: upgrade vllm to 0.22.1
velaraptor-runpod
2026-06-11 16:29:02 -05:00
d3a962c33b
Merge pull request #301 from adithyaJRunpod/feature/tuned-configs
v2.21.1
chrisvela and GitHub
2026-06-11 14:26:00 -05:00
105c125698
Merge pull request #300 from runpod-workers/feat/0.21.0
chrisvela and GitHub
2026-06-11 12:47:08 -05:00
0a0ccfcb60
Add tuned configs for Llama 3.1 8B and Qwen3 8B
AdithyaJob
2026-06-10 21:07:41 -07:00
c8ce53c72c
fix: add kenels, and fix for cuda
velaraptor-runpod
2026-06-10 16:01:53 -05:00
9618e799ba
chore: fix cuda libraries
velaraptor-runpod
2026-06-04 15:35:58 -05:00
cb3f077dba
feat: upgrade vllm to 0.21.0
velaraptor-runpod
2026-06-03 14:43:56 -05:00
69646b9e99
Merge pull request #294 from runpod-workers/feat/allow-config
v2.20.1
chrisvela and GitHub
2026-06-02 20:28:02 -05:00
8b991a7ad7
Merge pull request #297 from runpod-workers/jhcipar/bump-runpod-python-version
Jacob Cipar and GitHub
2026-06-02 11:17:48 -04:00
dac05b62b3
fix: make .runpod/tests.json hub tests pass on CUDA 13.0 (#299 )
v2.20.0
Tim Pietrusky and GitHub
2026-06-02 17:08:54 +02:00
d356c31675
feat: bump runpod-python version
jhcipar
2026-06-01 20:28:40 -04:00
14b74a4989
chore: re-enable .runpod/tests.json hub tests (#295 )
v2.19.2
v2.19.1
Tim Pietrusky and GitHub
2026-06-01 17:52:23 +02:00
80072047ab
feat: allow config.yaml like vllm serve
velaraptor-runpod
2026-05-29 15:50:22 -05:00
50aba8fb57
Merge pull request #293 from runpod-workers/fix/update-deep-gemm-hub-value
v2.19.0
chrisvela and GitHub
2026-05-27 11:51:48 -05:00
9edc5715ce
fix: update configuration.md
velaraptor-runpod
2026-05-27 11:33:37 -05:00
4c91f2c5b5
fix: update VLLM_USE_DEEP_GEMM hub to default to 0
velaraptor-runpod
2026-05-27 11:26:52 -05:00
6265b99348
Merge pull request #288 from runpod-workers/feat/0.20.0
chrisvela and GitHub
2026-05-26 17:17:45 -05:00
026f8d700b
fix: specify deepgemm commit version
velaraptor-runpod
2026-05-21 18:46:14 -05:00
146bdb0252
Merge branch 'main' into feat/0.20.0
chrisvela and GitHub
2026-05-21 16:04:39 -05:00
da01193a3d
chore: fix readme
velaraptor-runpod
2026-05-21 15:57:40 -05:00
c2e6cc9f61
chore: update readme with correct vllm version
velaraptor-runpod
2026-05-21 15:39:19 -05:00
69968a6b39
chore: fix logging, warning for text prompt
velaraptor-runpod
2026-05-21 15:34:09 -05:00
32b29d4c6c
fix: add deepgemm, update base image and hub for cuda 13.0
velaraptor-runpod
2026-05-20 17:43:42 -05:00
dcea4fc4f9
fix dockerfile
velaraptor-runpod
2026-05-15 12:08:31 -04:00
9c139e8ceb
update: update to 0.20.1, update dockerfile to cuda 13
velaraptor-runpod
2026-05-15 11:35:53 -04:00
678bb4be8f
feat: update to 0.20.1 for patch fixes
velaraptor-runpod
2026-05-07 11:58:22 -05:00
87d7365126
Merge pull request #292 from runpod-workers/fix/open-ai
v2.18.1
chrisvela and GitHub
2026-05-01 18:06:11 -05:00
0e83616f93
fix: fix warmup
velaraptor-runpod
2026-05-01 17:39:51 -05:00
ab6d39dcf8
Merge pull request #291 from runpod-workers/bug/281-hf-token
v2.18.0
chrisvela and GitHub
2026-05-01 15:32:04 -05:00
ed315a175e
merge main
velaraptor-runpod
2026-05-01 15:28:05 -05:00
73f030ae5e
Merge branch 'main' into bug/281-hf-token
velaraptor-runpod
2026-05-01 14:33:51 -05:00
8a099c1723
Merge pull request #287 from runpod-workers/feat/0.19.1
chrisvela and GitHub
2026-05-01 14:29:39 -05:00
ff87840a58
fix: add enforce_eager as true, add pytorch_alloc_conf to expandle_segments to True for OOM, for hub defaults
velaraptor-runpod
2026-05-01 14:13:03 -05:00
7dc853b1fe
chore: remove release to trigger on release publish, just use tags. duplicate
velaraptor-runpod
2026-05-01 10:13:32 -05:00
a8b754b92a
merge main
velaraptor-runpod
2026-05-01 10:12:43 -05:00
6357aeda51
Merge pull request #290 from runpod-workers/fix/fix-old-actions
v2.17.0
chrisvela and GitHub
2026-05-01 10:01:22 -05:00
0140b29c44
chore: add release notes to slack notification
velaraptor-runpod
2026-05-01 09:48:43 -05:00
0cb8aeae77
chore: add specific runpod version
velaraptor-runpod
2026-05-01 09:47:23 -05:00
cd8f9e9560
Merge branch 'main' into fix/fix-old-actions
chrisvela and GitHub
2026-04-30 21:57:45 -05:00
895fd25fac
Merge pull request #286 from runpod-workers/feat/0.18.1
chrisvela and GitHub
2026-04-30 21:56:07 -05:00
7bb8df73af
bug: fix hf-token being passed in engineargs
velaraptor-runpod
2026-04-30 20:37:30 -05:00
747cdf5891
chore: update readme vllm version
velaraptor-runpod
2026-04-30 20:26:23 -05:00
3d4af5df9b
chore: update readme vllm version
velaraptor-runpod
2026-04-30 20:25:35 -05:00
72547aa3bb
chore: update readme vllm version
velaraptor-runpod
2026-04-30 20:25:02 -05:00
577fd8c3c3
fix: fix old github actions, trigger release on publish release
velaraptor-runpod
2026-04-30 20:22:24 -05:00
f49f35456e
Merge pull request #285 from runpod-workers/feat/0.17.1
v.2.16.0
chrisvela and GitHub
2026-04-30 20:05:45 -05:00
cff7b09ef2
Merge pull request #289 from runpod-workers/feat/add-notifications
chrisvela and GitHub
2026-04-30 20:03:48 -05:00
04b342c675
fix permissions
velaraptor-runpod
2026-04-30 20:00:48 -05:00
5b29643799
feat: add notifications for new prs, issues, and new releases of vllm
velaraptor-runpod
2026-04-30 19:55:29 -05:00
4f8a16df5d
fix: update transformers to >=5
velaraptor-runpod
2026-04-30 19:41:09 -05:00
22356ee2b3
feat: upgrade vLLM to 0.20.0
velaraptor-runpod and Claude Sonnet 4.6
2026-04-30 18:39:07 -05:00
fa42ecd79a
fix: resolve lowercase HF cache paths when MODEL_NAME uses original casing
velaraptor-runpod and Claude Sonnet 4.6
2026-04-30 17:54:14 -05:00
178c72238e
fix: surface LORA_MODULES parse failures instead of silently loading zero adapters
velaraptor-runpod and Claude Sonnet 4.6
2026-04-30 17:49:09 -05:00
e6950bdebd
feat: upgrade vLLM to 0.19.1
velaraptor-runpod and Claude Sonnet 4.6
2026-04-30 17:41:11 -05:00
a774cefe85
fix: clean workspace file
velaraptor-runpod
2026-04-30 17:29:00 -05:00
9de17d49b7
feat: update vllm to 0.18.1
velaraptor-runpod
2026-04-30 17:25:23 -05:00
296556a6f7
feat: update vllm to 0.17.1
velaraptor-runpod
2026-04-30 17:21:03 -05:00
a1544ea70d
Merge pull request #277 from runpod-workers/feat/lmcache
v.2.15.0
chrisvela and GitHub
2026-04-28 19:44:00 -03:00
3403889528
fix: address review comments on responses/messages handlers and lmcache guard
Tim Pietrusky
2026-04-23 11:28:50 +02:00
f299204770
docs: fix anthropic messages path and missing comma in routes list
Tim Pietrusky
2026-04-23 10:54:24 +02:00
1ed25eea20
update readme with responses and messages routes
velaraptor-runpod
2026-04-16 15:30:30 -05:00