 Marut PandyaandGitHub
|
0869068e7c
|
Create tests.json
|
2025-03-31 15:32:06 -07:00 |
|
|
Marut PandyaandGitHub
|
19f25b17de
|
Update hub.json
|
2025-03-31 15:14:40 -07:00 |
|
|
Marut PandyaandGitHub
|
70aa748c30
|
Update hub.json
|
2025-03-31 15:14:24 -07:00 |
|
|
Marut PandyaandGitHub
|
da3e5f524b
|
Merge pull request #171 from runpod-workers/update
update vllm 0.8.2
v2.2.0
|
2025-03-26 15:56:04 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
Hailong YangandGitHub
|
fa31d9663d
|
Update README.md
|
2025-03-11 22:24:22 -04:00 |
|
|
Marut PandyaandGitHub
|
b8fb313483
|
Merge pull request #168 from runpod-workers/wc-up
update worker config
|
2025-03-11 12:23:22 -07:00 |
|
|
pandyamarut
|
9635daf336
|
update worker config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-11 12:22:53 -07:00 |
|
|
Marut PandyaandGitHub
|
fb4e700090
|
Merge pull request #166 from KAJdev/patch-1
Create hub.json
|
2025-03-10 12:14:47 -07:00 |
|
|
Marut PandyaandGitHub
|
d4872ed9c8
|
Merge pull request #167 from runpod-workers/rachfop-patch-1
Update requirements.txt
|
2025-03-10 12:13:47 -07:00 |
|
|
Patrick RachfordandGitHub
|
b2eef50c3b
|
Update requirements.txt
Use the latest runpod version from here:
https://github.com/runpod/runpod-python/releases/tag/1.7.7
|
2025-03-10 08:46:28 -07:00 |
|
|
Ezekiel WotringandGitHub
|
8005bcc1a8
|
fix description
|
2025-03-07 13:22:34 -09:00 |
|
|
Ezekiel WotringandGitHub
|
aa7b00ddda
|
Create hub.json
|
2025-03-07 13:20:52 -09:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
v2.1.0
|
2025-02-24 18:39:14 -08:00 |
|
|
Marut PandyaandGitHub
|
f9d0fcb78c
|
Merge pull request #165 from runpod-workers/hfix
[HF]: set default max_token size
|
2025-02-24 17:24:50 -08:00 |
|
|
pandyamarut
|
99b952e55e
|
set default max_token size
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 17:22:44 -08:00 |
|
|
Marut PandyaandGitHub
|
389fad7952
|
Merge pull request #164 from runpod-workers/up-0.7.3
update vllm
|
2025-02-24 15:08:02 -08:00 |
|
|
pandyamarut
|
56dc4ad075
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 15:01:45 -08:00 |
|
|
Marut PandyaandGitHub
|
6dcf39e159
|
Merge pull request #161 from runpod-workers/revert-157-m-c
Revert "Enabling model caching."
|
2025-02-18 14:33:27 -08:00 |
|
|
Marut PandyaandGitHub
|
2b1d618287
|
Revert "Enabling model caching."
|
2025-02-18 10:45:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d7e9c49fe4
|
Merge pull request #160 from runpod-workers/up-0.7.2
update vllm
|
2025-02-11 13:59:18 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Marut PandyaandGitHub
|
6fc770415d
|
Merge pull request #157 from runpod-workers/m-c
Enabling model caching.
|
2025-02-06 11:52:19 -08:00 |
|
|
Marut PandyaandGitHub
|
9e8d9196b0
|
Merge pull request #154 from runpod-workers/fx-eng
update engine.py
v1.9.0
|
2025-01-28 21:40:26 -08:00 |
|
|
pandyamarut
|
30dd7c1eb5
|
update engine.py
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 21:40:00 -08:00 |
|
|
Marut PandyaandGitHub
|
aa7c37ffb0
|
Merge pull request #152 from runpod-workers/fix0.7.0-1
update oai serving classes
|
2025-01-28 20:58:40 -08:00 |
|
|
pandyamarut
|
dc8c88027a
|
update serving classes
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 20:58:07 -08:00 |
|
|
Marut PandyaandGitHub
|
a948e90caa
|
Merge pull request #151 from runpod-workers/fix0.7.0
dynamic lora loading
|
2025-01-28 19:02:59 -08:00 |
|
|
pandyamarut
|
c703254f71
|
dynamic lora loading
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 19:00:57 -08:00 |
|
|
Marut PandyaandGitHub
|
2747106403
|
Merge pull request #150 from runpod-workers/up-0.7.0
update vllm 0.7.0
|
2025-01-28 14:27:37 -08:00 |
|
|
pandyamarut
|
91ed30e9a2
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:21:33 -08:00 |
|
|
pandyamarut
|
fcbfe84f63
|
update vllm 0.7.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:18:10 -08:00 |
|
|
Marut PandyaandGitHub
|
610429df23
|
Merge pull request #143 from sihamouda/main
Add limit_mm_per_prompt engine argument for multimodels input
|
2025-01-27 16:41:47 -08:00 |
|
|
Hailong Yang
|
a578c6df23
|
update docker file
|
2025-01-26 23:28:27 -05:00 |
|
|
sihamouda
|
0e3359a70e
|
add engine argument for multimodels input
|
2025-01-19 02:44:39 +01:00 |
|
|
Marut PandyaandGitHub
|
3f0a20d28e
|
Merge pull request #141 from runpod-workers/main
Rebase
|
2025-01-02 20:49:48 -08:00 |
|
|
pandyamarut
|
8e3c26be14
|
update worker-config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
v1.8.0
|
2024-12-30 17:41:10 -08:00 |
|
|
pandyamarut
|
66ea8b1110
|
update engine
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 17:13:03 -08:00 |
|
|
Marut PandyaandGitHub
|
a3d432afdf
|
Merge pull request #140 from runpod-workers/nw-updte
upgrade vllm version
|
2024-12-30 15:23:44 -08:00 |
|
|
pandyamarut
|
06c2bb1715
|
upgrade vllm version
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-12-30 15:20:11 -08:00 |
|
|
Marut PandyaandGitHub
|
d2e355eae9
|
Merge pull request #137 from kldzj/fix-tool-calling
fix: openai tool calling
|
2024-12-15 20:50:47 -08:00 |
|
|
kldzj
|
b7787d8ca8
|
fix: remove unused import
|
2024-12-06 16:29:06 +01:00 |
|
|
kldzj
|
b1fca5d257
|
fix: move tool flags away from engine args
|
2024-12-06 16:07:23 +01:00 |
|
|
kldzj
|
3e86d16892
|
fix: openai tool calling
|
2024-12-06 13:08:48 +01:00 |
|
|
Marut PandyaandGitHub
|
d9f54ce76a
|
Update README.md
|
2024-11-29 16:30:45 -08:00 |
|
|
Marut PandyaandGitHub
|
149da95cd0
|
Merge pull request #133 from kldzj/tool-calling
feat: add tool calling flags
|
2024-11-29 16:29:56 -08:00 |
|
|
Marut PandyaandGitHub
|
0a89394f1d
|
Update worker-config.json
|
2024-11-29 16:29:33 -08:00 |
|
|
Nikolai Kolodziej
|
8df7f41f1d
|
fix: set empty tool_call_parser to None
|
2024-11-24 06:55:43 +01:00 |
|
|
Nikolai Kolodziej
|
4d7b8c03c0
|
feat: tool calling flags
|
2024-11-24 06:51:41 +01:00 |
|
|
pandyamarut
|
6c6bf50379
|
update env
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2024-11-22 15:14:57 -08:00 |
|