12 Commits

Include renames

Author	SHA1	Message	Date
Tim PietruskyandGitHub	dac05b62b3	fix: make .runpod/tests.json hub tests pass on CUDA 13.0 (#299) ... Three coupled fixes verified end-to-end on a private fork (TimPietruskyRunPod/worker-vllm v0.1.3 → both hub tests passing): 1. tests.json allowedCudaVersions: 12.x → 13.0 The Dockerfile and hub.json moved to CUDA 13.0 in v2.20.0 (#288, #289), but tests.json was still pinned to 12.5–12.9, so the test pod was scheduled on a GPU with driver < 13.0 and container init failed at the nvidia-container-cli hook with "unsatisfied condition: cuda>=13.0". 2. requirements.txt kernels<0.15 huggingface/kernels v0.15.1 tightened LayerRepository to require a revision or version argument (https://github.com/huggingface/kernels/pull/544). transformers >=5 still constructs LayerRepository(repo_id=..., layer_name=...) without either, so worker import raised ValueError during `from transformers import ...`. 0.14.1 is the last safe release. 3. tests.json timeout 30000 → 300000 vLLM cold start (torch.compile + FlashInfer warmup) on RTX 4090 for SmolLM2-135M takes ~60–70s before the first request can be served. The previous 30s per-test timeout fired before the worker came up, producing "context cancelled or timed out: context deadline exceeded" for every test even when the worker was healthy. 300s gives enough headroom for cold start + the actual inference call. Refs: DR-1161	2026-06-02 17:08:54 +02:00
Tim PietruskyandGitHub	14b74a4989	chore: re-enable .runpod/tests.json hub tests (#295) ... Rename tests_json back to tests.json to re-enable the automated hub tests that were temporarily disabled in #253. Refs: DR-1161	2026-06-01 17:52:23 +02:00
Tim PietruskyandGitHub	6d6cbe7095	fix: deactivate RunPod tests to fix hub release (#253) ... Rename tests.json to tests_json to temporarily disable automated tests while fixing the release on the hub.	2026-01-22 18:06:36 +01:00
Tim PietruskyandGitHub	f8bf82469c	fix(config): update allowed cuda versions in hub and tests config (#236) ... remove unsupported cuda versions (12.1-12.3) from hub.json and tests.json to fix compatibility issues with worker deployment - hub.json: remove 12.1, 12.2, 12.3 from allowedCudaVersions - tests.json: remove 12.1, 12.2, 12.3, 12.4 from allowedCudaVersions refs: AE-1452	2025-11-14 17:22:43 +01:00
Tim PietruskyandGitHub	6337a6673a	fix: allow also CUDA 12.8 & 12.9 (#228)	2025-10-24 18:48:26 +02:00
3 people	a0fe1dfdad	feat: better hub support & concise README for the main repo (#215) ... * feat: moved config into docs; added banner; auto detect "messages" in input * docs: moved config into docs * chore: added .DS_Store * chore: get the original stuff working again * chore: remove all changes * docs: reduced toc and added small config table --------- Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>	2025-09-01 16:47:48 +02:00
3 people	5f0fc69d75	feat: prepare worker-vllm for the hub (#214) ... * docs: remove outdated video; remove old info; added missing config for tools * ci: use proper release for dev (pr only) and production (release only) * ci(hub): added openai example; use smollm2 as base model * docs: added conventions to be able to work with ai ide's * chore: remove outdated stuff * chore: update copyright to 2025 * ci: added github permissions * feat: added gpuIds, gputCount and allowedCudaVersions; removed default value for LOAD_FORMAT to check which influence this has on the ui --------- Co-authored-by: Tim Pietrusky <tim.pietrusky@runpod.io>	2025-08-28 10:09:27 +02:00
Marut PandyaandGitHub	9b7ca4d0b0	Update tests.json	2025-05-08 17:12:59 -07:00
Marut PandyaandGitHub	0b6bc7a2be	Update tests.json	2025-05-07 11:14:50 -07:00
Ezekiel WotringandGitHub	3a095f3e10	Update tests.json	2025-04-03 09:10:01 -08:00
Marut PandyaandGitHub	067f0bc173	Update tests.json	2025-03-31 15:49:31 -07:00
Marut PandyaandGitHub	0869068e7c	Create tests.json	2025-03-31 15:32:06 -07:00