5f0fc69d75
feat: prepare worker-vllm for the hub ( #214 )
...
Release / release (push) Waiting to run
* docs: remove outdated video; remove old info; added missing config for tools
* ci: use proper release for dev (pr only) and production (release only)
* ci(hub): added openai example; use smollm2 as base model
* docs: added conventions to be able to work with ai ide's
* chore: remove outdated stuff
* chore: update copyright to 2025
* ci: added github permissions
* feat: added gpuIds, gputCount and allowedCudaVersions; removed default value for LOAD_FORMAT to check which influence this has on the ui
---------
Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io >
2025-08-28 10:09:27 +02:00
Marut Pandya and GitHub
aef1187a30
Merge pull request #211 from runpod-workers/fix/allow-none-as-string
...
fix: allow "None" as value & parse the value of RAW_OPENAI_OUTPUT correctly
2025-08-21 11:35:54 -07:00
Tim Pietrusky
f7514dea4b
refactor: moved MODEL_NAME & HF_TOKEN out of advanced into the top section
2025-08-18 16:05:43 +02:00
Tim Pietrusky
121a3dd44b
fix: parse value for RAW_OPENAI_OUTPUT correctly
2025-08-13 12:20:44 +02:00
Tim Pietrusky
e2e111b942
fix: allow "None" as string for setting env variables (like quantization)
2025-08-13 10:27:00 +02:00
Marut Pandya and GitHub
7aa17463d3
Merge pull request #200 from runpod-workers/release/0.10.0
...
chore(release): 0.10.0
2025-08-11 15:33:51 -07:00
Marut Pandya and GitHub
72a643dd0c
Merge pull request #207 from JhennerTigreros/main
...
Update requirements and engine creation to support new 0.10.0 vLLM version
2025-08-09 09:08:19 -07:00
Marut Pandya and GitHub
15f569f970
Merge pull request #208 from runpod-workers/revert-202-feat/proper-deployment
...
[Revert]"feat: added dev & release workflows; added conventions to support AI IDE"
2025-08-09 09:06:53 -07:00
Marut Pandya and GitHub
2f2bd4c749
Revert "feat: added dev & release workflows; added conventions to support AI IDE"
2025-08-09 09:01:52 -07:00
Jhenner Tigreros
fb0c030797
fix initialization on openaiservingmodels
2025-08-07 16:40:06 -05:00
Jhenner Tigreros
8b02a703b4
fix issues
2025-08-07 15:59:43 -05:00
Jhenner Tigreros
d8863139d6
add model to test
2025-08-07 15:28:02 -05:00
Jhenner Tigreros and GitHub
f5a063956e
Fix requirements.txt to support gpt-oss models
2025-08-07 15:13:37 -05:00
Marut Pandya and GitHub
18748fd73e
Merge pull request #202 from runpod-workers/feat/proper-deployment
...
feat: added dev & release workflows; added conventions to support AI IDE
2025-08-04 17:13:47 -07:00
Tim Pietrusky
0133c23be8
ci: added manual workflow trigger for releases
2025-08-04 09:58:23 +02:00
Tim Pietrusky
a129cff47d
docs: use "version" instead of actual version, so that people can check the releases
2025-07-31 12:03:17 +02:00
Tim Pietrusky
30f2c4630e
refactor: use correct version
2025-07-31 12:02:46 +02:00
Tim Pietrusky
b98636e432
feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed
2025-07-28 16:40:20 +02:00
pandyamarut
185205c750
chore(release): 0.10.0
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-07-25 10:18:06 -07:00
pandyamarut
b948e530a1
chore(release): 0.10.0
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-07-25 10:17:50 -07:00
Marut Pandya and GitHub
4f22d6f107
Merge pull request #193 from runpod-workers/release/0.9.1
...
chore(release): v0.9.1
2025-06-26 13:23:33 -07:00
pandyamarut
8839689132
chore(release): v0.9.1
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-06-26 11:06:23 -07:00
Marut Pandya and GitHub
5ddc2326cd
Merge pull request #191 from runpod-workers/feat/0.9.1
...
feat: update to 0.9.1 & added CONFIG_FORMAT to run magistral
2025-06-26 10:17:54 -07:00
Tim Pietrusky
46a3300cbb
chore: reverted changeds to only focus on vllm update
2025-06-20 14:56:39 +02:00
Tim Pietrusky
1e9a731380
Fix Mistral tokenizer initialization: let vLLM handle tokenizer for mistral models
2025-06-14 15:31:56 +02:00
Tim Pietrusky
c47e649a24
Add CONFIG_FORMAT environment variable support
2025-06-14 15:12:46 +02:00
Tim Pietrusky
7192bcaeef
Trigger build automatically on feat/0.9.1 branch
2025-06-14 13:49:22 +02:00
Tim Pietrusky
8665ffb78d
Revert workflow back to original configuration
2025-06-14 13:47:16 +02:00
Tim Pietrusky
57431b30ad
Fix workflow: use standard GitHub runners and actions
2025-06-14 13:42:46 +02:00
Tim Pietrusky
437a84c77a
ci: added workflow to build the image
2025-06-14 13:31:36 +02:00
Tim Pietrusky
a4062fc488
feat: update to 0.9.1
2025-06-14 13:31:27 +02:00
Marut Pandya and GitHub
9631407c1d
Merge pull request #189 from runpod-workers/hf-mm
...
add multi modal env var
2025-06-10 17:03:18 -07:00
pandyamarut
1a93932ab2
add multi modal env var
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-06-10 17:02:42 -07:00
Marut Pandya and GitHub
4c6c88c3b9
Merge pull request #188 from WorstDev01/add-mm-limit-parameter
...
Add multimodal limit parameter support
2025-06-10 14:59:21 -07:00
WorstDev01
a58a76783d
Add multimodal limit parameter support
...
- Updated convert_limit_mm_per_prompt to handle multiple types
- Added limit_mm_per_prompt parameter for image and video limits
Note: Consider adjusting default values - perhaps image limit > 1 or video=1
2025-06-10 23:36:47 +02:00
Marut Pandya and GitHub
26919c8849
Merge pull request #185 from runpod-workers/up-0.9.0
...
Version upgrade
2025-06-05 12:00:05 -07:00
pandyamarut
70cd1c8113
update vllm version 0.9.0
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-06-05 11:59:15 -07:00
Marut Pandya and GitHub
deeff579f8
Merge pull request #183 from SorenDreano/fix/model_name_in_local_args
...
remove requirements for MODEL_NAME in local_model_args.json
2025-06-04 12:45:00 -07:00
Soren Dreano
11f96a09d7
remove requirements for MODEL_NAME in local_model_args.json
...
We want to use the same local_model_args.json for multiple models
which have different names. It would be very convenient to only
have a single local_args file and not have to create it every time
A warning should be enough for users
2025-05-23 17:59:19 +02:00
Marut Pandya and GitHub
23e8ecf85b
Merge pull request #169 from RedHitMark/main
...
fix lora and multi-lora
2025-05-14 16:25:26 -07:00
Marut Pandya and GitHub
6db2c44d3b
Update Dockerfile
2025-05-09 09:27:54 -07:00
Marut Pandya and GitHub
9b7ca4d0b0
Update tests.json
2025-05-08 17:12:59 -07:00
Marut Pandya and GitHub
2a4eaf0356
Merge pull request #182 from runpod-workers/up-0.8.5
...
update vllm
2025-05-08 11:40:23 -07:00
pandyamarut
ba19cc97bf
update vllm
...
Signed-off-by: pandyamarut <pandyamarut@gmail.com >
2025-05-08 11:34:58 -07:00
Marut Pandya and GitHub
6075f2c590
Merge pull request #181 from runpod-workers/revert-177-main
...
Revert "fix: added back limit_mm_per_prompt to engine args"
2025-05-07 12:31:15 -07:00
Marut Pandya and GitHub
a9786a2481
Revert "fix: added back limit_mm_per_prompt to engine args"
2025-05-07 12:29:33 -07:00
Marut Pandya and GitHub
0b6bc7a2be
Update tests.json
2025-05-07 11:14:50 -07:00
Marut Pandya and GitHub
d0ab58ee17
Merge pull request #180 from muhsinking/patch-1
...
Update README.md table to fix table of contents links
2025-05-03 21:02:37 -07:00
Marut Pandya and GitHub
4e474c41c8
Merge pull request #177 from aleksandar-babic/main
...
fix: added back limit_mm_per_prompt to engine args
2025-05-03 21:01:58 -07:00
Mo King and GitHub
e9d13c155e
Update README.md to fix table of contents links to environment variable sections
...
Separates environment variables into multiple tables, so that the table of contents will correctly jump to the appropriate section when clicked.
2025-04-30 12:45:54 -04:00
