 pandyamarut
|
ba19cc97bf
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-05-08 11:34:58 -07:00 |
|
|
Marut PandyaandGitHub
|
6075f2c590
|
Merge pull request #181 from runpod-workers/revert-177-main
Revert "fix: added back limit_mm_per_prompt to engine args"
|
2025-05-07 12:31:15 -07:00 |
|
|
Marut PandyaandGitHub
|
a9786a2481
|
Revert "fix: added back limit_mm_per_prompt to engine args"
|
2025-05-07 12:29:33 -07:00 |
|
|
Marut PandyaandGitHub
|
0b6bc7a2be
|
Update tests.json
|
2025-05-07 11:14:50 -07:00 |
|
|
Marut PandyaandGitHub
|
d0ab58ee17
|
Merge pull request #180 from muhsinking/patch-1
Update README.md table to fix table of contents links
|
2025-05-03 21:02:37 -07:00 |
|
|
Marut PandyaandGitHub
|
4e474c41c8
|
Merge pull request #177 from aleksandar-babic/main
fix: added back limit_mm_per_prompt to engine args
|
2025-05-03 21:01:58 -07:00 |
|
|
Mo KingandGitHub
|
e9d13c155e
|
Update README.md to fix table of contents links to environment variable sections
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
|
2025-04-30 12:45:54 -04:00 |
|
|
Marut PandyaandGitHub
|
e807342e90
|
Merge pull request #178 from runpod-workers/up-0.8.4
update vllm
v2.4.0
|
2025-04-21 13:15:03 -07:00 |
|
|
pandyamarut
|
f33e8d2bcd
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-21 13:14:32 -07:00 |
|
|
Marut PandyaandGitHub
|
6b64bb93bd
|
Merge pull request #147 from mohamednaji7/BitsAndBytes
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
|
2025-04-21 11:39:53 -07:00 |
|
|
Aleksandar Babic
|
a53cf777ff
|
chore: added limit_mm_per_prompt to worker config
|
2025-04-21 10:14:05 -04:00 |
|
|
Aleksandar Babic
|
cfc258674b
|
chore: added trailing comma to the final arg
|
2025-04-21 10:06:08 -04:00 |
|
|
Aleksandar Babic
|
8beafed06b
|
fix: added back limit_mm_per_prompt to engine args
|
2025-04-21 10:02:46 -04:00 |
|
|
Marut PandyaandGitHub
|
d77c53c3b7
|
Merge pull request #175 from runpod-workers/up-0.8.3
update vllm
v2.3.0
v2.3.1
v2.3.2
|
2025-04-07 11:58:03 -07:00 |
|
|
pandyamarut
|
3d067cd472
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-07 11:54:57 -07:00 |
|
|
Marut PandyaandGitHub
|
f1360ccae7
|
Merge pull request #173 from KAJdev/patch-1
Update hub.json
|
2025-04-03 14:52:06 -07:00 |
|
|
Marut PandyaandGitHub
|
96f1b86126
|
Merge pull request #174 from KAJdev/patch-2
Update tests.json
|
2025-04-03 10:14:49 -07:00 |
|
|
Ezekiel WotringandGitHub
|
3a095f3e10
|
Update tests.json
|
2025-04-03 09:10:01 -08:00 |
|
|
Ezekiel WotringandGitHub
|
7cf7f3e4e6
|
Update hub.json
|
2025-04-03 09:04:28 -08:00 |
|
|
Marut PandyaandGitHub
|
4395d0c67b
|
Update hub.json
v2.2.2
|
2025-04-03 08:10:28 -07:00 |
|
|
Marut PandyaandGitHub
|
5864fa6843
|
Update hub.json
v.2.2.1
|
2025-03-31 15:55:35 -07:00 |
|
|
Marut PandyaandGitHub
|
067f0bc173
|
Update tests.json
|
2025-03-31 15:49:31 -07:00 |
|
|
Marut PandyaandGitHub
|
0869068e7c
|
Create tests.json
|
2025-03-31 15:32:06 -07:00 |
|
|
Marut PandyaandGitHub
|
19f25b17de
|
Update hub.json
|
2025-03-31 15:14:40 -07:00 |
|
|
Marut PandyaandGitHub
|
70aa748c30
|
Update hub.json
|
2025-03-31 15:14:24 -07:00 |
|
|
Marut PandyaandGitHub
|
da3e5f524b
|
Merge pull request #171 from runpod-workers/update
update vllm 0.8.2
v2.2.0
|
2025-03-26 15:56:04 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
RedHitMark
|
084d000324
|
fix lora and multi-lora
|
2025-03-14 21:45:09 +01:00 |
|
|
Hailong YangandGitHub
|
fa31d9663d
|
Update README.md
|
2025-03-11 22:24:22 -04:00 |
|
|
Marut PandyaandGitHub
|
b8fb313483
|
Merge pull request #168 from runpod-workers/wc-up
update worker config
|
2025-03-11 12:23:22 -07:00 |
|
|
pandyamarut
|
9635daf336
|
update worker config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-11 12:22:53 -07:00 |
|
|
Marut PandyaandGitHub
|
fb4e700090
|
Merge pull request #166 from KAJdev/patch-1
Create hub.json
|
2025-03-10 12:14:47 -07:00 |
|
|
Marut PandyaandGitHub
|
d4872ed9c8
|
Merge pull request #167 from runpod-workers/rachfop-patch-1
Update requirements.txt
|
2025-03-10 12:13:47 -07:00 |
|
|
Patrick RachfordandGitHub
|
b2eef50c3b
|
Update requirements.txt
Use the latest runpod version from here:
https://github.com/runpod/runpod-python/releases/tag/1.7.7
|
2025-03-10 08:46:28 -07:00 |
|
|
Ezekiel WotringandGitHub
|
8005bcc1a8
|
fix description
|
2025-03-07 13:22:34 -09:00 |
|
|
Ezekiel WotringandGitHub
|
aa7b00ddda
|
Create hub.json
|
2025-03-07 13:20:52 -09:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
v2.1.0
|
2025-02-24 18:39:14 -08:00 |
|
|
Marut PandyaandGitHub
|
f9d0fcb78c
|
Merge pull request #165 from runpod-workers/hfix
[HF]: set default max_token size
|
2025-02-24 17:24:50 -08:00 |
|
|
pandyamarut
|
99b952e55e
|
set default max_token size
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 17:22:44 -08:00 |
|
|
Marut PandyaandGitHub
|
389fad7952
|
Merge pull request #164 from runpod-workers/up-0.7.3
update vllm
|
2025-02-24 15:08:02 -08:00 |
|
|
pandyamarut
|
56dc4ad075
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 15:01:45 -08:00 |
|
|
Marut PandyaandGitHub
|
6dcf39e159
|
Merge pull request #161 from runpod-workers/revert-157-m-c
Revert "Enabling model caching."
|
2025-02-18 14:33:27 -08:00 |
|
|
Marut PandyaandGitHub
|
2b1d618287
|
Revert "Enabling model caching."
|
2025-02-18 10:45:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d7e9c49fe4
|
Merge pull request #160 from runpod-workers/up-0.7.2
update vllm
|
2025-02-11 13:59:18 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Marut PandyaandGitHub
|
6fc770415d
|
Merge pull request #157 from runpod-workers/m-c
Enabling model caching.
|
2025-02-06 11:52:19 -08:00 |
|
|
Mohamed NagyandGitHub
|
04288240f6
|
updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row
|
2025-02-02 14:58:48 +02:00 |
|
|
Marut PandyaandGitHub
|
9e8d9196b0
|
Merge pull request #154 from runpod-workers/fx-eng
update engine.py
v1.9.0
|
2025-01-28 21:40:26 -08:00 |
|
|
pandyamarut
|
30dd7c1eb5
|
update engine.py
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 21:40:00 -08:00 |
|
|
Marut PandyaandGitHub
|
aa7c37ffb0
|
Merge pull request #152 from runpod-workers/fix0.7.0-1
update oai serving classes
|
2025-01-28 20:58:40 -08:00 |
|