Commit Graph

Select branches

Hide Pull Requests

main

0.1.0

0.2.0

0.2.1

0.2.2

0.2.3

0.3.0

0.3.1

0.3.2

1.0.0

1.0.1

v.2.15.0

v.2.16.0

v.2.2.1

v1.1

v1.2.0

v1.3.0

v1.3.1

v1.4.0

v1.5.0

v1.6.0

v1.7.0

v1.8.0

v1.9.0

v2.1.0

v2.10.0

v2.11.0

v2.11.1

v2.11.2

v2.11.3

v2.12.0

v2.12.1

v2.12.2

v2.12.3

v2.13.0

v2.13.1

v2.14.0

v2.17.0

v2.18.0

v2.18.1

v2.19.0

v2.19.1

v2.19.2

v2.2.0

v2.2.2

v2.20.0

v2.20.1

v2.21.1

v2.22.0

v2.22.1

v2.22.2

v2.22.3

v2.22.4

v2.22.5

v2.23.0

v2.3.0

v2.3.1

v2.3.2

v2.4.0

v2.5.0

v2.5.1

v2.6.0

v2.8.0

v2.9.0

v2.9.1

v2.9.2

v2.9.3

v2.9.4

v2.9.5

v2.9.6

Mono Color

• 26919c8849 Merge pull request #185 from runpod-workers/up-0.9.0 v2.6.0 Marut PandyaandGitHub 2025-06-05 12:00:05 -07:00
• 70cd1c8113 update vllm version 0.9.0 pandyamarut 2025-06-05 11:59:15 -07:00
• deeff579f8 Merge pull request #183 from SorenDreano/fix/model_name_in_local_args Marut PandyaandGitHub 2025-06-04 12:45:00 -07:00
• 11f96a09d7 remove requirements for MODEL_NAME in local_model_args.json Soren Dreano 2025-05-23 17:59:19 +02:00
• 23e8ecf85b Merge pull request #169 from RedHitMark/main Marut PandyaandGitHub 2025-05-14 16:25:26 -07:00
• 6db2c44d3b Update Dockerfile Marut PandyaandGitHub 2025-05-09 09:27:54 -07:00
• 9b7ca4d0b0 Update tests.json v2.5.1 Marut PandyaandGitHub 2025-05-08 17:12:59 -07:00
• 2a4eaf0356 Merge pull request #182 from runpod-workers/up-0.8.5 v2.5.0 Marut PandyaandGitHub 2025-05-08 11:40:23 -07:00
• ba19cc97bf update vllm pandyamarut 2025-05-08 11:34:58 -07:00
• 6075f2c590 Merge pull request #181 from runpod-workers/revert-177-main Marut PandyaandGitHub 2025-05-07 12:31:15 -07:00
• a9786a2481 Revert "fix: added back limit_mm_per_prompt to engine args" Marut PandyaandGitHub 2025-05-07 12:29:33 -07:00
• 0b6bc7a2be Update tests.json Marut PandyaandGitHub 2025-05-07 11:14:50 -07:00
• d0ab58ee17 Merge pull request #180 from muhsinking/patch-1 Marut PandyaandGitHub 2025-05-03 21:02:37 -07:00
• 4e474c41c8 Merge pull request #177 from aleksandar-babic/main Marut PandyaandGitHub 2025-05-03 21:01:58 -07:00
• e9d13c155e Update README.md to fix table of contents links to environment variable sections Mo KingandGitHub 2025-04-30 12:45:54 -04:00
• e807342e90 Merge pull request #178 from runpod-workers/up-0.8.4 v2.4.0 Marut PandyaandGitHub 2025-04-21 13:15:03 -07:00
• f33e8d2bcd update vllm pandyamarut 2025-04-21 13:14:32 -07:00
• 6b64bb93bd Merge pull request #147 from mohamednaji7/BitsAndBytes Marut PandyaandGitHub 2025-04-21 11:39:53 -07:00
• a53cf777ff chore: added limit_mm_per_prompt to worker config Aleksandar Babic 2025-04-21 10:14:05 -04:00
• cfc258674b chore: added trailing comma to the final arg Aleksandar Babic 2025-04-21 10:06:08 -04:00
• 8beafed06b fix: added back limit_mm_per_prompt to engine args Aleksandar Babic 2025-04-21 10:02:46 -04:00
• d77c53c3b7 Merge pull request #175 from runpod-workers/up-0.8.3 v2.3.2 v2.3.1 v2.3.0 Marut PandyaandGitHub 2025-04-07 11:58:03 -07:00
• 3d067cd472 update vllm pandyamarut 2025-04-07 11:54:57 -07:00
• f1360ccae7 Merge pull request #173 from KAJdev/patch-1 Marut PandyaandGitHub 2025-04-03 14:52:06 -07:00
• 96f1b86126 Merge pull request #174 from KAJdev/patch-2 Marut PandyaandGitHub 2025-04-03 10:14:49 -07:00
• 3a095f3e10 Update tests.json Ezekiel WotringandGitHub 2025-04-03 09:10:01 -08:00
• 7cf7f3e4e6 Update hub.json Ezekiel WotringandGitHub 2025-04-03 09:04:28 -08:00
• 4395d0c67b Update hub.json v2.2.2 Marut PandyaandGitHub 2025-04-03 08:10:28 -07:00
• 5864fa6843 Update hub.json v.2.2.1 Marut PandyaandGitHub 2025-03-31 15:55:35 -07:00
• 067f0bc173 Update tests.json Marut PandyaandGitHub 2025-03-31 15:49:31 -07:00
• 0869068e7c Create tests.json Marut PandyaandGitHub 2025-03-31 15:32:06 -07:00
• 19f25b17de Update hub.json Marut PandyaandGitHub 2025-03-31 15:14:40 -07:00
• 70aa748c30 Update hub.json Marut PandyaandGitHub 2025-03-31 15:14:24 -07:00
• da3e5f524b Merge pull request #171 from runpod-workers/update v2.2.0 Marut PandyaandGitHub 2025-03-26 15:56:04 -07:00
• acbdf63de8 update vllm 0.8.2 pandyamarut 2025-03-26 15:55:30 -07:00
• 084d000324 fix lora and multi-lora RedHitMark 2025-03-14 21:45:09 +01:00
• fa31d9663d Update README.md Hailong YangandGitHub 2025-03-11 22:24:22 -04:00
• b8fb313483 Merge pull request #168 from runpod-workers/wc-up Marut PandyaandGitHub 2025-03-11 12:23:22 -07:00
• 9635daf336 update worker config pandyamarut 2025-03-11 12:22:53 -07:00
• fb4e700090 Merge pull request #166 from KAJdev/patch-1 Marut PandyaandGitHub 2025-03-10 12:14:47 -07:00
• d4872ed9c8 Merge pull request #167 from runpod-workers/rachfop-patch-1 Marut PandyaandGitHub 2025-03-10 12:13:47 -07:00
• b2eef50c3b Update requirements.txt Patrick RachfordandGitHub 2025-03-10 08:46:28 -07:00
• 8005bcc1a8 fix description Ezekiel WotringandGitHub 2025-03-07 13:22:34 -09:00
• aa7b00ddda Create hub.json Ezekiel WotringandGitHub 2025-03-07 13:20:52 -09:00
• dc6f3239bd Update README.md v2.1.0 Marut PandyaandGitHub 2025-02-24 18:39:14 -08:00
• f9d0fcb78c Merge pull request #165 from runpod-workers/hfix Marut PandyaandGitHub 2025-02-24 17:24:50 -08:00
• 99b952e55e set default max_token size pandyamarut 2025-02-24 17:22:44 -08:00
• 389fad7952 Merge pull request #164 from runpod-workers/up-0.7.3 Marut PandyaandGitHub 2025-02-24 15:08:02 -08:00
• 56dc4ad075 update vllm pandyamarut 2025-02-24 15:01:45 -08:00
• 6dcf39e159 Merge pull request #161 from runpod-workers/revert-157-m-c Marut PandyaandGitHub 2025-02-18 14:33:27 -08:00
• 2b1d618287 Revert "Enabling model caching." Marut PandyaandGitHub 2025-02-18 10:45:47 -08:00
• d7e9c49fe4 Merge pull request #160 from runpod-workers/up-0.7.2 Marut PandyaandGitHub 2025-02-11 13:59:18 -08:00
• c9791f1163 update vllm pandyamarut 2025-02-11 13:27:57 -08:00
• 6fc770415d Merge pull request #157 from runpod-workers/m-c Marut PandyaandGitHub 2025-02-06 11:52:19 -08:00
• 04288240f6 updating the . in ['awq', 'squeezellm', 'gptq'. 'bitsandbytes'] for the QUNATIZATION row Mohamed NagyandGitHub 2025-02-02 14:58:48 +02:00
• 9e8d9196b0 Merge pull request #154 from runpod-workers/fx-eng v1.9.0 Marut PandyaandGitHub 2025-01-28 21:40:26 -08:00
• 30dd7c1eb5 update engine.py pandyamarut 2025-01-28 21:40:00 -08:00
• aa7c37ffb0 Merge pull request #152 from runpod-workers/fix0.7.0-1 Marut PandyaandGitHub 2025-01-28 20:58:40 -08:00
• dc8c88027a update serving classes pandyamarut 2025-01-28 20:58:07 -08:00
• a948e90caa Merge pull request #151 from runpod-workers/fix0.7.0 Marut PandyaandGitHub 2025-01-28 19:02:59 -08:00
• c703254f71 dynamic lora loading pandyamarut 2025-01-28 19:00:57 -08:00
• 2747106403 Merge pull request #150 from runpod-workers/up-0.7.0 Marut PandyaandGitHub 2025-01-28 14:27:37 -08:00
• 91ed30e9a2 update readme pandyamarut 2025-01-28 14:21:33 -08:00
• fcbfe84f63 update vllm 0.7.0 pandyamarut 2025-01-28 14:18:10 -08:00
• 610429df23 Merge pull request #143 from sihamouda/main Marut PandyaandGitHub 2025-01-27 16:41:47 -08:00
• a578c6df23 update docker file Hailong Yang 2025-01-26 23:28:27 -05:00
• 9299f43b8b solving "typing_extensions" compatibility with "bitsandbytes" Mohamed NagyandGitHub 2025-01-22 18:06:46 +02:00
• 131c17569f correct access to "args" dictionary mohamednaji7 2025-01-21 22:33:28 +02:00
• 8882f6d50b adding 'bitsandbytes' to QUANTIZATION mohamednaji7 2025-01-21 14:46:40 +02:00
• 331bc30101 adding 'bitsandbytes' option mohamednaji7 2025-01-21 14:08:37 +02:00
• a27f72a33a inforce args.quantization for bnb load_froamt mohamednaji7 2025-01-21 14:01:32 +02:00
• 7167985f23 including bitsandbytes "src:https://docs.vllm.ai/en/stable/quantization/bnb.html" mohamednaji7 2025-01-21 13:49:36 +02:00
• 0e3359a70e add engine argument for multimodels input sihamouda 2025-01-19 02:44:39 +01:00
• 3f0a20d28e Merge pull request #141 from runpod-workers/main Marut PandyaandGitHub 2025-01-02 20:49:48 -08:00
• 8e3c26be14 update worker-config v1.8.0 pandyamarut 2024-12-30 17:41:10 -08:00
• 66ea8b1110 update engine pandyamarut 2024-12-30 17:13:03 -08:00
• a3d432afdf Merge pull request #140 from runpod-workers/nw-updte Marut PandyaandGitHub 2024-12-30 15:23:44 -08:00
• 06c2bb1715 upgrade vllm version pandyamarut 2024-12-30 15:20:11 -08:00
• d2e355eae9 Merge pull request #137 from kldzj/fix-tool-calling Marut PandyaandGitHub 2024-12-15 20:50:47 -08:00
• b7787d8ca8 fix: remove unused import kldzj 2024-12-06 16:29:06 +01:00
• b1fca5d257 fix: move tool flags away from engine args kldzj 2024-12-06 16:07:23 +01:00
• 3e86d16892 fix: openai tool calling kldzj 2024-12-06 13:08:48 +01:00
• d9f54ce76a Update README.md Marut PandyaandGitHub 2024-11-29 16:30:45 -08:00
• 149da95cd0 Merge pull request #133 from kldzj/tool-calling Marut PandyaandGitHub 2024-11-29 16:29:56 -08:00
• 0a89394f1d Update worker-config.json Marut PandyaandGitHub 2024-11-29 16:29:33 -08:00
• 8df7f41f1d fix: set empty tool_call_parser to None Nikolai Kolodziej 2024-11-24 06:55:43 +01:00
• 4d7b8c03c0 feat: tool calling flags Nikolai Kolodziej 2024-11-24 06:51:41 +01:00
• 6c6bf50379 update env pandyamarut 2024-11-22 15:14:57 -08:00
• 27a2ee5754 add model cache pandyamarut 2024-11-22 13:11:12 -08:00
• 2df915a145 Merge pull request #132 from runpod-workers/wc-uo v1.7.0 Marut PandyaandGitHub 2024-11-20 14:54:45 -08:00
• aadc025849 update worker-config pandyamarut 2024-11-20 14:42:56 -08:00
• 8b4a49073d Merge pull request #131 from runpod-workers/up-0.6.4 Marut PandyaandGitHub 2024-11-20 10:37:46 -08:00
• 4e10641d69 update vllm pandyamarut 2024-11-19 12:14:04 -08:00
• 6e8696c12a Merge pull request #121 from sven-knoblauch/lora-modules Marut PandyaandGitHub 2024-10-31 15:07:02 -04:00
• b49e81a75a Merge pull request #126 from runpod-workers/up-wc-1 Marut PandyaandGitHub 2024-10-15 17:52:13 -07:00
• 65932f85e1 update worker-config pandyamarut 2024-10-15 17:47:58 -07:00
• 94840cfbbb Update README.md Marut PandyaandGitHub 2024-10-15 17:38:31 -07:00
• ce47c41f4a Merge pull request #125 from runpod-workers/up-0.6.3 v1.6.0 Marut PandyaandGitHub 2024-10-15 17:04:20 -07:00
• c03ecc42fe update vllm pandyamarut 2024-10-15 16:49:41 -07:00
• ae56b9f43d Merge pull request #123 from runpod-workers/dependency-update-refactored Dean QuiñanolaandGitHub 2024-10-13 20:23:33 -07:00