 pandyamarut
|
1a93932ab2
|
add multi modal env var
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-06-10 17:02:42 -07:00 |
|
|
Marut PandyaandGitHub
|
4c6c88c3b9
|
Merge pull request #188 from WorstDev01/add-mm-limit-parameter
Add multimodal limit parameter support
|
2025-06-10 14:59:21 -07:00 |
|
|
Marut PandyaandGitHub
|
26919c8849
|
Merge pull request #185 from runpod-workers/up-0.9.0
Version upgrade
|
2025-06-05 12:00:05 -07:00 |
|
|
pandyamarut
|
70cd1c8113
|
update vllm version 0.9.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-06-05 11:59:15 -07:00 |
|
|
Marut PandyaandGitHub
|
deeff579f8
|
Merge pull request #183 from SorenDreano/fix/model_name_in_local_args
remove requirements for MODEL_NAME in local_model_args.json
|
2025-06-04 12:45:00 -07:00 |
|
|
Marut PandyaandGitHub
|
23e8ecf85b
|
Merge pull request #169 from RedHitMark/main
fix lora and multi-lora
|
2025-05-14 16:25:26 -07:00 |
|
|
Marut PandyaandGitHub
|
6db2c44d3b
|
Update Dockerfile
|
2025-05-09 09:27:54 -07:00 |
|
|
Marut PandyaandGitHub
|
9b7ca4d0b0
|
Update tests.json
|
2025-05-08 17:12:59 -07:00 |
|
|
Marut PandyaandGitHub
|
2a4eaf0356
|
Merge pull request #182 from runpod-workers/up-0.8.5
update vllm
|
2025-05-08 11:40:23 -07:00 |
|
|
pandyamarut
|
ba19cc97bf
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-05-08 11:34:58 -07:00 |
|
|
Marut PandyaandGitHub
|
6075f2c590
|
Merge pull request #181 from runpod-workers/revert-177-main
Revert "fix: added back limit_mm_per_prompt to engine args"
|
2025-05-07 12:31:15 -07:00 |
|
|
Marut PandyaandGitHub
|
a9786a2481
|
Revert "fix: added back limit_mm_per_prompt to engine args"
|
2025-05-07 12:29:33 -07:00 |
|
|
Marut PandyaandGitHub
|
0b6bc7a2be
|
Update tests.json
|
2025-05-07 11:14:50 -07:00 |
|
|
Marut PandyaandGitHub
|
d0ab58ee17
|
Merge pull request #180 from muhsinking/patch-1
Update README.md table to fix table of contents links
|
2025-05-03 21:02:37 -07:00 |
|
|
Marut PandyaandGitHub
|
4e474c41c8
|
Merge pull request #177 from aleksandar-babic/main
fix: added back limit_mm_per_prompt to engine args
|
2025-05-03 21:01:58 -07:00 |
|
|
Marut PandyaandGitHub
|
e807342e90
|
Merge pull request #178 from runpod-workers/up-0.8.4
update vllm
|
2025-04-21 13:15:03 -07:00 |
|
|
pandyamarut
|
f33e8d2bcd
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-21 13:14:32 -07:00 |
|
|
Marut PandyaandGitHub
|
6b64bb93bd
|
Merge pull request #147 from mohamednaji7/BitsAndBytes
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
|
2025-04-21 11:39:53 -07:00 |
|
|
Marut PandyaandGitHub
|
d77c53c3b7
|
Merge pull request #175 from runpod-workers/up-0.8.3
update vllm
|
2025-04-07 11:58:03 -07:00 |
|
|
pandyamarut
|
3d067cd472
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-07 11:54:57 -07:00 |
|
|
Marut PandyaandGitHub
|
f1360ccae7
|
Merge pull request #173 from KAJdev/patch-1
Update hub.json
|
2025-04-03 14:52:06 -07:00 |
|
|
Marut PandyaandGitHub
|
96f1b86126
|
Merge pull request #174 from KAJdev/patch-2
Update tests.json
|
2025-04-03 10:14:49 -07:00 |
|
|
Marut PandyaandGitHub
|
4395d0c67b
|
Update hub.json
|
2025-04-03 08:10:28 -07:00 |
|
|
Marut PandyaandGitHub
|
5864fa6843
|
Update hub.json
|
2025-03-31 15:55:35 -07:00 |
|
|
Marut PandyaandGitHub
|
067f0bc173
|
Update tests.json
|
2025-03-31 15:49:31 -07:00 |
|
|
Marut PandyaandGitHub
|
0869068e7c
|
Create tests.json
|
2025-03-31 15:32:06 -07:00 |
|
|
Marut PandyaandGitHub
|
19f25b17de
|
Update hub.json
|
2025-03-31 15:14:40 -07:00 |
|
|
Marut PandyaandGitHub
|
70aa748c30
|
Update hub.json
|
2025-03-31 15:14:24 -07:00 |
|
|
Marut PandyaandGitHub
|
da3e5f524b
|
Merge pull request #171 from runpod-workers/update
update vllm 0.8.2
|
2025-03-26 15:56:04 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
Marut PandyaandGitHub
|
b8fb313483
|
Merge pull request #168 from runpod-workers/wc-up
update worker config
|
2025-03-11 12:23:22 -07:00 |
|
|
pandyamarut
|
9635daf336
|
update worker config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-11 12:22:53 -07:00 |
|
|
Marut PandyaandGitHub
|
fb4e700090
|
Merge pull request #166 from KAJdev/patch-1
Create hub.json
|
2025-03-10 12:14:47 -07:00 |
|
|
Marut PandyaandGitHub
|
d4872ed9c8
|
Merge pull request #167 from runpod-workers/rachfop-patch-1
Update requirements.txt
|
2025-03-10 12:13:47 -07:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
|
2025-02-24 18:39:14 -08:00 |
|
|
Marut PandyaandGitHub
|
f9d0fcb78c
|
Merge pull request #165 from runpod-workers/hfix
[HF]: set default max_token size
|
2025-02-24 17:24:50 -08:00 |
|
|
pandyamarut
|
99b952e55e
|
set default max_token size
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 17:22:44 -08:00 |
|
|
Marut PandyaandGitHub
|
389fad7952
|
Merge pull request #164 from runpod-workers/up-0.7.3
update vllm
|
2025-02-24 15:08:02 -08:00 |
|
|
pandyamarut
|
56dc4ad075
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 15:01:45 -08:00 |
|
|
Marut PandyaandGitHub
|
6dcf39e159
|
Merge pull request #161 from runpod-workers/revert-157-m-c
Revert "Enabling model caching."
|
2025-02-18 14:33:27 -08:00 |
|
|
Marut PandyaandGitHub
|
2b1d618287
|
Revert "Enabling model caching."
|
2025-02-18 10:45:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d7e9c49fe4
|
Merge pull request #160 from runpod-workers/up-0.7.2
update vllm
|
2025-02-11 13:59:18 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Marut PandyaandGitHub
|
6fc770415d
|
Merge pull request #157 from runpod-workers/m-c
Enabling model caching.
|
2025-02-06 11:52:19 -08:00 |
|
|
Marut PandyaandGitHub
|
9e8d9196b0
|
Merge pull request #154 from runpod-workers/fx-eng
update engine.py
|
2025-01-28 21:40:26 -08:00 |
|
|
pandyamarut
|
30dd7c1eb5
|
update engine.py
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 21:40:00 -08:00 |
|
|
Marut PandyaandGitHub
|
aa7c37ffb0
|
Merge pull request #152 from runpod-workers/fix0.7.0-1
update oai serving classes
|
2025-01-28 20:58:40 -08:00 |
|
|
pandyamarut
|
dc8c88027a
|
update serving classes
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 20:58:07 -08:00 |
|
|
Marut PandyaandGitHub
|
a948e90caa
|
Merge pull request #151 from runpod-workers/fix0.7.0
dynamic lora loading
|
2025-01-28 19:02:59 -08:00 |
|
|
pandyamarut
|
c703254f71
|
dynamic lora loading
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 19:00:57 -08:00 |
|
|
Marut PandyaandGitHub
|
2747106403
|
Merge pull request #150 from runpod-workers/up-0.7.0
update vllm 0.7.0
|
2025-01-28 14:27:37 -08:00 |
|
|
pandyamarut
|
91ed30e9a2
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:21:33 -08:00 |
|
|
pandyamarut
|
fcbfe84f63
|
update vllm 0.7.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:18:10 -08:00 |
|
|
Marut PandyaandGitHub
|
610429df23
|
Merge pull request #143 from sihamouda/main
Add limit_mm_per_prompt engine argument for multimodels input
|
2025-01-27 16:41:47 -08:00 |
|
|
Marut PandyaandGitHub
|
3f0a20d28e
|
Merge pull request #141 from runpod-workers/main
Rebase
|
2025-01-02 20:49:48 -08:00 |
|
|
pandyamarut
|
8e3c26be14
|
update worker-config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 17:41:10 -08:00 |
|
|
pandyamarut
|
66ea8b1110
|
update engine
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 17:13:03 -08:00 |
|
|
Marut PandyaandGitHub
|
a3d432afdf
|
Merge pull request #140 from runpod-workers/nw-updte
upgrade vllm version
|
2024-12-30 15:23:44 -08:00 |
|
|
pandyamarut
|
06c2bb1715
|
upgrade vllm version
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 15:20:11 -08:00 |
|
|
Marut PandyaandGitHub
|
d2e355eae9
|
Merge pull request #137 from kldzj/fix-tool-calling
fix: openai tool calling
|
2024-12-15 20:50:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d9f54ce76a
|
Update README.md
|
2024-11-29 16:30:45 -08:00 |
|
|
Marut PandyaandGitHub
|
149da95cd0
|
Merge pull request #133 from kldzj/tool-calling
feat: add tool calling flags
|
2024-11-29 16:29:56 -08:00 |
|
|
Marut PandyaandGitHub
|
0a89394f1d
|
Update worker-config.json
|
2024-11-29 16:29:33 -08:00 |
|
|
pandyamarut
|
6c6bf50379
|
update env
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-11-22 15:14:57 -08:00 |
|
|
pandyamarut
|
27a2ee5754
|
add model cache
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-11-22 13:11:12 -08:00 |
|
|
Marut PandyaandGitHub
|
2df915a145
|
Merge pull request #132 from runpod-workers/wc-uo
update worker-config
|
2024-11-20 14:54:45 -08:00 |
|
|
pandyamarut
|
aadc025849
|
update worker-config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-11-20 14:42:56 -08:00 |
|
|
Marut PandyaandGitHub
|
8b4a49073d
|
Merge pull request #131 from runpod-workers/up-0.6.4
[Core]Update vllm-0.6.4
|
2024-11-20 10:37:46 -08:00 |
|
|
pandyamarut
|
4e10641d69
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-11-19 12:14:04 -08:00 |
|
|
Marut PandyaandGitHub
|
6e8696c12a
|
Merge pull request #121 from sven-knoblauch/lora-modules
add changes for lora adapter support and /v1/models endpoint
|
2024-10-31 15:07:02 -04:00 |
|
|
Marut PandyaandGitHub
|
b49e81a75a
|
Merge pull request #126 from runpod-workers/up-wc-1
update worker-config
|
2024-10-15 17:52:13 -07:00 |
|
|
pandyamarut
|
65932f85e1
|
update worker-config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-10-15 17:47:58 -07:00 |
|
|
Marut PandyaandGitHub
|
94840cfbbb
|
Update README.md
|
2024-10-15 17:38:31 -07:00 |
|
|
Marut PandyaandGitHub
|
ce47c41f4a
|
Merge pull request #125 from runpod-workers/up-0.6.3
update vllm
|
2024-10-15 17:04:20 -07:00 |
|
|
pandyamarut
|
c03ecc42fe
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-10-15 16:49:41 -07:00 |
|
|
Marut PandyaandGitHub
|
d3ee3236c0
|
Merge pull request #118 from runpod-workers/up-wc
update worker-config
|
2024-10-01 11:23:02 -07:00 |
|
|
pandyamarut
|
0781e93054
|
update worker-config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-10-01 11:21:27 -07:00 |
|
|
Marut PandyaandGitHub
|
251e807012
|
Update README.md
|
2024-10-01 11:17:30 -07:00 |
|
|
Marut PandyaandGitHub
|
29346769ed
|
Merge pull request #117 from runpod-workers/up-0.6.2
update vllm
|
2024-10-01 11:05:40 -07:00 |
|
|
pandyamarut
|
1420091588
|
update vll
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-27 19:23:50 -07:00 |
|
|
Marut PandyaandGitHub
|
d46adeaee9
|
Merge pull request #110 from runpod-workers/up-0.6.1
update vllm v0.6.1
|
2024-09-16 15:12:50 -07:00 |
|
|
pandyamarut
|
5c0dca44bd
|
update
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-16 15:01:21 -07:00 |
|
|
pandyamarut
|
cc301ac123
|
update
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-16 15:00:01 -07:00 |
|
|
pandyamarut
|
2ac6a0108f
|
update vllm v0.6.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-16 14:55:40 -07:00 |
|
|
Marut PandyaandGitHub
|
b1554ea10f
|
Merge pull request #109 from runpod-workers/0.5.5-update
[Update] Docs, bug fix.
|
2024-09-06 12:36:09 -07:00 |
|
|
pandyamarut
|
0d794a3914
|
fix
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-06 12:26:09 -07:00 |
|
|
pandyamarut
|
3dad3a754c
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-06 12:21:34 -07:00 |
|
|
Marut PandyaandGitHub
|
44cef385df
|
Merge pull request #108 from runpod-workers/cmpl-htf
[Bug]fix oai completion api error
|
2024-09-06 11:06:33 -07:00 |
|
|
pandyamarut
|
814f50af38
|
fix oai completion api error
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-09-06 11:03:47 -07:00 |
|
|
Marut PandyaandGitHub
|
f3a530b7fe
|
Merge pull request #107 from runpod-workers/pandyamarut-patch-1
Update README.md
|
2024-08-28 23:32:48 -07:00 |
|
|
Marut PandyaandGitHub
|
cdf78e7c89
|
Update README.md
|
2024-08-28 23:32:36 -07:00 |
|
|
Marut PandyaandGitHub
|
ab40d9c9a8
|
Merge pull request #106 from runpod-workers/up-0.5.5
update vllm version 0.5.5
|
2024-08-28 23:31:15 -07:00 |
|
|
pandyamarut
|
3293245c81
|
update tags
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-28 23:28:39 -07:00 |
|
|
pandyamarut
|
5e1c8c8128
|
update vllm version 0.5.5
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-28 22:46:45 -07:00 |
|
|
Marut PandyaandGitHub
|
286d6ba702
|
Merge pull request #102 from carlson-svg/main
Add human readable worker-config.json
|
2024-08-26 20:22:47 -07:00 |
|
|
Marut PandyaandGitHub
|
2111c9e7a5
|
Update README.md
|
2024-08-12 21:02:43 -07:00 |
|
|
Marut PandyaandGitHub
|
7f46582949
|
Merge pull request #96 from runpod-workers/rel-v0.5.4
update vllm version 0.5.4
|
2024-08-09 15:01:16 -07:00 |
|
|
Marut PandyaandGitHub
|
571ef2b805
|
Update README.md
|
2024-08-09 14:58:46 -07:00 |
|
|
pandyamarut
|
967eaba573
|
change to float
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-08-09 14:41:07 -07:00 |
|
|
Marut PandyaandGitHub
|
eb75a3ac03
|
Merge pull request #95 from runpod-workers/runpod-package-update
Update runpod package version
|
2024-08-09 12:04:25 -07:00 |
|