 Mo KingandGitHub
|
e9d13c155e
|
Update README.md to fix table of contents links to environment variable sections
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
|
2025-04-30 12:45:54 -04:00 |
|
|
Marut PandyaandGitHub
|
e807342e90
|
Merge pull request #178 from runpod-workers/up-0.8.4
update vllm
v2.4.0
|
2025-04-21 13:15:03 -07:00 |
|
|
pandyamarut
|
f33e8d2bcd
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-21 13:14:32 -07:00 |
|
|
Marut PandyaandGitHub
|
6b64bb93bd
|
Merge pull request #147 from mohamednaji7/BitsAndBytes
completing the "bitsandbytes" option - based on https://docs.vllm.ai/en/stable/quantization/bnb.html
|
2025-04-21 11:39:53 -07:00 |
|
|
Marut PandyaandGitHub
|
d77c53c3b7
|
Merge pull request #175 from runpod-workers/up-0.8.3
update vllm
v2.3.0
v2.3.1
v2.3.2
|
2025-04-07 11:58:03 -07:00 |
|
|
pandyamarut
|
3d067cd472
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-04-07 11:54:57 -07:00 |
|
|
Marut PandyaandGitHub
|
f1360ccae7
|
Merge pull request #173 from KAJdev/patch-1
Update hub.json
|
2025-04-03 14:52:06 -07:00 |
|
|
Marut PandyaandGitHub
|
96f1b86126
|
Merge pull request #174 from KAJdev/patch-2
Update tests.json
|
2025-04-03 10:14:49 -07:00 |
|
|
Ezekiel WotringandGitHub
|
3a095f3e10
|
Update tests.json
|
2025-04-03 09:10:01 -08:00 |
|
|
Ezekiel WotringandGitHub
|
7cf7f3e4e6
|
Update hub.json
|
2025-04-03 09:04:28 -08:00 |
|
|
Marut PandyaandGitHub
|
4395d0c67b
|
Update hub.json
v2.2.2
|
2025-04-03 08:10:28 -07:00 |
|
|
Marut PandyaandGitHub
|
5864fa6843
|
Update hub.json
v.2.2.1
|
2025-03-31 15:55:35 -07:00 |
|
|
Marut PandyaandGitHub
|
067f0bc173
|
Update tests.json
|
2025-03-31 15:49:31 -07:00 |
|
|
Marut PandyaandGitHub
|
0869068e7c
|
Create tests.json
|
2025-03-31 15:32:06 -07:00 |
|
|
Marut PandyaandGitHub
|
19f25b17de
|
Update hub.json
|
2025-03-31 15:14:40 -07:00 |
|
|
Marut PandyaandGitHub
|
70aa748c30
|
Update hub.json
|
2025-03-31 15:14:24 -07:00 |
|
|
Marut PandyaandGitHub
|
da3e5f524b
|
Merge pull request #171 from runpod-workers/update
update vllm 0.8.2
v2.2.0
|
2025-03-26 15:56:04 -07:00 |
|
|
pandyamarut
|
acbdf63de8
|
update vllm 0.8.2
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-26 15:55:30 -07:00 |
|
|
Hailong YangandGitHub
|
fa31d9663d
|
Update README.md
|
2025-03-11 22:24:22 -04:00 |
|
|
Marut PandyaandGitHub
|
b8fb313483
|
Merge pull request #168 from runpod-workers/wc-up
update worker config
|
2025-03-11 12:23:22 -07:00 |
|
|
pandyamarut
|
9635daf336
|
update worker config
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-03-11 12:22:53 -07:00 |
|
|
Marut PandyaandGitHub
|
fb4e700090
|
Merge pull request #166 from KAJdev/patch-1
Create hub.json
|
2025-03-10 12:14:47 -07:00 |
|
|
Marut PandyaandGitHub
|
d4872ed9c8
|
Merge pull request #167 from runpod-workers/rachfop-patch-1
Update requirements.txt
|
2025-03-10 12:13:47 -07:00 |
|
|
Patrick RachfordandGitHub
|
b2eef50c3b
|
Update requirements.txt
Use the latest runpod version from here:
https://github.com/runpod/runpod-python/releases/tag/1.7.7
|
2025-03-10 08:46:28 -07:00 |
|
|
Ezekiel WotringandGitHub
|
8005bcc1a8
|
fix description
|
2025-03-07 13:22:34 -09:00 |
|
|
Ezekiel WotringandGitHub
|
aa7b00ddda
|
Create hub.json
|
2025-03-07 13:20:52 -09:00 |
|
|
Marut PandyaandGitHub
|
dc6f3239bd
|
Update README.md
v2.1.0
|
2025-02-24 18:39:14 -08:00 |
|
|
Marut PandyaandGitHub
|
f9d0fcb78c
|
Merge pull request #165 from runpod-workers/hfix
[HF]: set default max_token size
|
2025-02-24 17:24:50 -08:00 |
|
|
pandyamarut
|
99b952e55e
|
set default max_token size
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 17:22:44 -08:00 |
|
|
Marut PandyaandGitHub
|
389fad7952
|
Merge pull request #164 from runpod-workers/up-0.7.3
update vllm
|
2025-02-24 15:08:02 -08:00 |
|
|
pandyamarut
|
56dc4ad075
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-24 15:01:45 -08:00 |
|
|
Marut PandyaandGitHub
|
6dcf39e159
|
Merge pull request #161 from runpod-workers/revert-157-m-c
Revert "Enabling model caching."
|
2025-02-18 14:33:27 -08:00 |
|
|
Marut PandyaandGitHub
|
2b1d618287
|
Revert "Enabling model caching."
|
2025-02-18 10:45:47 -08:00 |
|
|
Marut PandyaandGitHub
|
d7e9c49fe4
|
Merge pull request #160 from runpod-workers/up-0.7.2
update vllm
|
2025-02-11 13:59:18 -08:00 |
|
|
pandyamarut
|
c9791f1163
|
update vllm
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-02-11 13:27:57 -08:00 |
|
|
Marut PandyaandGitHub
|
6fc770415d
|
Merge pull request #157 from runpod-workers/m-c
Enabling model caching.
|
2025-02-06 11:52:19 -08:00 |
|
|
Mohamed NagyandGitHub
|
04288240f6
|
updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row
|
2025-02-02 14:58:48 +02:00 |
|
|
Marut PandyaandGitHub
|
9e8d9196b0
|
Merge pull request #154 from runpod-workers/fx-eng
update engine.py
v1.9.0
|
2025-01-28 21:40:26 -08:00 |
|
|
pandyamarut
|
30dd7c1eb5
|
update engine.py
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 21:40:00 -08:00 |
|
|
Marut PandyaandGitHub
|
aa7c37ffb0
|
Merge pull request #152 from runpod-workers/fix0.7.0-1
update oai serving classes
|
2025-01-28 20:58:40 -08:00 |
|
|
pandyamarut
|
dc8c88027a
|
update serving classes
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 20:58:07 -08:00 |
|
|
Marut PandyaandGitHub
|
a948e90caa
|
Merge pull request #151 from runpod-workers/fix0.7.0
dynamic lora loading
|
2025-01-28 19:02:59 -08:00 |
|
|
pandyamarut
|
c703254f71
|
dynamic lora loading
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 19:00:57 -08:00 |
|
|
Marut PandyaandGitHub
|
2747106403
|
Merge pull request #150 from runpod-workers/up-0.7.0
update vllm 0.7.0
|
2025-01-28 14:27:37 -08:00 |
|
|
pandyamarut
|
91ed30e9a2
|
update readme
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:21:33 -08:00 |
|
|
pandyamarut
|
fcbfe84f63
|
update vllm 0.7.0
Signed-off-by: pandyamarut <pandyamarut@gmail.com>
|
2025-01-28 14:18:10 -08:00 |
|
|
Marut PandyaandGitHub
|
610429df23
|
Merge pull request #143 from sihamouda/main
Add limit_mm_per_prompt engine argument for multimodels input
|
2025-01-27 16:41:47 -08:00 |
|
|
Hailong Yang
|
a578c6df23
|
update docker file
|
2025-01-26 23:28:27 -05:00 |
|
|
Mohamed NagyandGitHub
|
9299f43b8b
|
solving "typing_extensions" compatibility with "bitsandbytes"
```
2025-01-22 18:04:01 [INFO] > [stage-0 5/8] RUN --mount=type=cache,target=/root/.cache/pip python3 -m pip install --upgrade pip && python3 -m pip install --upgrade -r /requirements.txt:
2025-01-22 18:04:01 [INFO] #13 8.904
2025-01-22 18:04:01 [INFO] #13 8.904 The conflict is caused by:
2025-01-22 18:04:01 [INFO] #13 8.904 The user requested typing-extensions==4.7.1
2025-01-22 18:04:01 [INFO] #13 8.904 bitsandbytes 0.45.0 depends on typing_extensions>=4.8.0
```
|
2025-01-22 18:06:46 +02:00 |
|
|
mohamednaji7
|
131c17569f
|
correct access to "args" dictionary
|
2025-01-21 22:33:28 +02:00 |
|