owen/worker-vllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
499 Commits 1 Branch 69 Tags
08c6ff749059d3b72a3b4628bb15ada623389588
Commit Graph
120 Commits
Author SHA1 Message Date
velaraptor-runpod b9043639e9 requested changes/refactor 2026-02-25 16:07:38 -06:00
velaraptor-runpod efb093e198 add as VLLM_RUNPOD prefix and update readme 2026-02-24 17:37:57 -06:00
chrisvelaandGitHub b7c6d4f9a2 feat: update dockerfile to 12.9.1 (#267)
Release / release (push) Waiting to run 
* feat: update dockerfile to 12.9.1

* update readme on VLLM_NIGHTLY build arg
 2026-02-19 10:13:14 +01:00
Tim PietruskyandGitHub 66e1b1605b Merge pull request #226 from runpod-workers/fix/cse-839-max-concurrency
Release / release (push) Waiting to run 
fix: max concurrency = 30 instead of 300
 2025-10-22 22:54:21 +02:00
NERDDISCOGitHubTim Pietrusky
 		a0fe1dfdad feat: better hub support & concise README for the main repo (#215)
Release / release (push) Waiting to run 
* feat: moved config into docs; added banner; auto detect "messages" in input

* docs: moved config into docs

* chore: added .DS_Store

* chore: get the original stuff working again

* chore: remove all changes

* docs: reduced toc and added small config table

---------

Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-09-01 16:47:48 +02:00
Tim Pietrusky 0e0d6df859 docs: updated example-tag for dev and release 2025-08-28 14:28:19 +02:00
NERDDISCOGitHubTim Pietrusky
 		5f0fc69d75 feat: prepare worker-vllm for the hub (#214)
Release / release (push) Waiting to run 
* docs: remove outdated video; remove old info; added missing config for tools

* ci: use proper release for dev (pr only) and production (release only)

* ci(hub): added openai example; use smollm2 as base model

* docs: added conventions to be able to work with ai ide's

* chore: remove outdated stuff

* chore: update copyright to 2025

* ci: added github permissions

* feat: added gpuIds, gputCount and allowedCudaVersions; removed default value for LOAD_FORMAT to check which influence this has on the ui

---------

Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>
 2025-08-28 10:09:27 +02:00
Marut PandyaandGitHub 2f2bd4c749 Revert "feat: added dev & release workflows; added conventions to support AI IDE" 2025-08-09 09:01:52 -07:00
Tim Pietrusky a129cff47d docs: use "version" instead of actual version, so that people can check the releases 2025-07-31 12:03:17 +02:00
Tim Pietrusky b98636e432 feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed 2025-07-28 16:40:20 +02:00
pandyamarut 8839689132 chore(release): v0.9.1 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-06-26 11:06:23 -07:00
pandyamarut 70cd1c8113 update vllm version 0.9.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-06-05 11:59:15 -07:00
Marut PandyaandGitHub 23e8ecf85b Merge pull request #169 from RedHitMark/main 
fix lora and multi-lora
 2025-05-14 16:25:26 -07:00
pandyamarut ba19cc97bf update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-05-08 11:34:58 -07:00
Mo KingandGitHub e9d13c155e Update README.md to fix table of contents links to environment variable sections 
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
 2025-04-30 12:45:54 -04:00
pandyamarut f33e8d2bcd update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-04-21 13:14:32 -07:00
Marut PandyaandGitHub 6b64bb93bd Merge pull request #147 from mohamednaji7/BitsAndBytes 
completing the "bitsandbytes" option - based on  https://docs.vllm.ai/en/stable/quantization/bnb.html
 2025-04-21 11:39:53 -07:00
pandyamarut 3d067cd472 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-04-07 11:54:57 -07:00
pandyamarut acbdf63de8 update vllm 0.8.2 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-03-26 15:55:30 -07:00
RedHitMark 084d000324 fix lora and multi-lora 2025-03-14 21:45:09 +01:00
Hailong YangandGitHub fa31d9663d Update README.md 2025-03-11 22:24:22 -04:00
Marut PandyaandGitHub dc6f3239bd Update README.md 2025-02-24 18:39:14 -08:00
pandyamarut c9791f1163 update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-02-11 13:27:57 -08:00
Mohamed NagyandGitHub 04288240f6 updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row 2025-02-02 14:58:48 +02:00
pandyamarut 91ed30e9a2 update readme 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2025-01-28 14:21:33 -08:00
mohamednaji7 8882f6d50b adding 'bitsandbytes' to QUANTIZATION 2025-01-21 14:46:40 +02:00
pandyamarut 06c2bb1715 upgrade vllm version 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-12-30 15:20:11 -08:00
Marut PandyaandGitHub d9f54ce76a Update README.md 2024-11-29 16:30:45 -08:00
Marut PandyaandGitHub 94840cfbbb Update README.md 2024-10-15 17:38:31 -07:00
Dean QuiñanolaandGitHub c28aa02576 Update README.md 
v1.5.0 not v15
 2024-10-12 17:11:59 -07:00
Marut PandyaandGitHub 251e807012 Update README.md 2024-10-01 11:17:30 -07:00
pandyamarut cc301ac123 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 15:00:01 -07:00
pandyamarut 2ac6a0108f update vllm v0.6.0 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-16 14:55:40 -07:00
pandyamarut 3dad3a754c update vllm 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-09-06 12:21:34 -07:00
Marut PandyaandGitHub cdf78e7c89 Update README.md 2024-08-28 23:32:36 -07:00
pandyamarut 3293245c81 update tags 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-28 23:28:39 -07:00
Marut PandyaandGitHub 286d6ba702 Merge pull request #102 from carlson-svg/main 
Add human readable worker-config.json
 2024-08-26 20:22:47 -07:00
carlson-svg 4fa4a8e0e6 added to worker config docs to table of contents + added side note 2024-08-26 01:20:18 -07:00
Marut PandyaandGitHub 2111c9e7a5 Update README.md 2024-08-12 21:02:43 -07:00
Marut PandyaandGitHub 571ef2b805 Update README.md 2024-08-09 14:58:46 -07:00
pandyamarut 967eaba573 change to float 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-09 14:41:07 -07:00
Marut PandyaandGitHub f023f57217 Update README.md 2024-08-07 15:38:26 -07:00
Marut PandyaandGitHub 673597fd46 Update README.md 2024-08-07 15:32:23 -07:00
Marut PandyaandGitHub c50543ebd9 Update README.md 2024-08-07 15:30:33 -07:00
pandyamarut 3498e99b2f update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-05 14:33:56 -07:00
pandyamarut 5da96ce9a6 update 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-05 14:26:56 -07:00
Marut PandyaandGitHub e32626ca9d Update README.md 2024-08-05 14:19:38 -07:00
pandyamarut e846ecae9d update readme 
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
 2024-08-02 14:13:55 -07:00
Marut PandyaandGitHub 9f066be620 Update README.md 2024-08-02 13:29:18 -07:00
Marut PandyaandGitHub e1b41795f7 Update README.md 2024-07-31 12:46:34 -07:00