22 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Tim PietruskyandGitHub	6337a6673a	fix: allow also CUDA 12.8 & 12.9 (#228)	2025-10-24 18:48:26 +02:00
Tim PietruskyandGitHub	66e1b1605b	Merge pull request #226 from runpod-workers/fix/cse-839-max-concurrency ... fix: max concurrency = 30 instead of 300	2025-10-22 22:54:21 +02:00
Tim PietruskyandGitHub	60c8f257a8	Merge pull request #227 from runpod-workers/chore/vllm-0.11.0 ... chore: update vllm to 0.11.0	2025-10-22 22:53:51 +02:00
Tim Pietrusky	fae16e7ee1	chore: update vllm to 0.11.0	2025-10-22 13:40:53 -07:00
Tim Pietrusky	ecd562e112	fix: remove "access token" as this is handled by the platform	2025-09-19 21:00:47 +02:00
Tim Pietrusky	0e0d6df859	docs: updated example-tag for dev and release	2025-08-28 14:28:19 +02:00
Tim Pietrusky	d1718aec00	ci: removed "github release" step as that is not needed	2025-08-28 14:27:50 +02:00
Tim Pietrusky	f7514dea4b	refactor: moved MODEL_NAME & HF_TOKEN out of advanced into the top section	2025-08-18 16:05:43 +02:00
Tim Pietrusky	121a3dd44b	fix: parse value for RAW_OPENAI_OUTPUT correctly	2025-08-13 12:20:44 +02:00
Tim Pietrusky	e2e111b942	fix: allow "None" as string for setting env variables (like quantization)	2025-08-13 10:27:00 +02:00
Tim Pietrusky	0133c23be8	ci: added manual workflow trigger for releases	2025-08-04 09:58:23 +02:00
Tim Pietrusky	a129cff47d	docs: use "version" instead of actual version, so that people can check the releases	2025-07-31 12:03:17 +02:00
Tim Pietrusky	30f2c4630e	refactor: use correct version	2025-07-31 12:02:46 +02:00
Tim Pietrusky	b98636e432	feat: added "dev" and "release" workflows; removed "vllm-base-image" as it's not needed	2025-07-28 16:40:20 +02:00
Tim Pietrusky	46a3300cbb	chore: reverted changeds to only focus on vllm update	2025-06-20 14:56:39 +02:00
Tim Pietrusky	1e9a731380	Fix Mistral tokenizer initialization: let vLLM handle tokenizer for mistral models	2025-06-14 15:31:56 +02:00
Tim Pietrusky	c47e649a24	Add CONFIG_FORMAT environment variable support	2025-06-14 15:12:46 +02:00
Tim Pietrusky	7192bcaeef	Trigger build automatically on feat/0.9.1 branch	2025-06-14 13:49:22 +02:00
Tim Pietrusky	8665ffb78d	Revert workflow back to original configuration	2025-06-14 13:47:16 +02:00
Tim Pietrusky	57431b30ad	Fix workflow: use standard GitHub runners and actions	2025-06-14 13:42:46 +02:00
Tim Pietrusky	437a84c77a	ci: added workflow to build the image	2025-06-14 13:31:36 +02:00
Tim Pietrusky	a4062fc488	feat: update to 0.9.1	2025-06-14 13:31:27 +02:00