 MagnusandGitHub
|
ea82e2a901
|
remove "inference" from title to make it more consistent with the other runpod repos on the hub
|
2026-06-03 18:22:06 +02:00 |
|
|
mags0ft
|
b24c32c024
|
re-activate automatic testing
|
2026-02-12 08:45:54 +01:00 |
|
|
mags0ft
|
0c814177fe
|
add caching support for models in start.sh and update documentation
|
2025-12-26 14:49:03 +01:00 |
|
|
mags0ft
|
0a59d57025
|
rename tests.json temporarily to skip apparently buggy RunPod CI
The RunPod support told me to do this until the issues are resolved.
|
2025-12-26 11:37:23 +01:00 |
|
|
mags0ft
|
398b59c0a1
|
update test timeout and default LLAMA_SERVER_CMD_ARGS for improved performance
|
2025-12-25 19:17:31 +01:00 |
|
|
mags0ft
|
403d318ffc
|
update default args to include -ngl 99, improve startup sleep duration
|
2025-11-19 19:16:18 +01:00 |
|
|
mags0ft
|
381ed9ffff
|
prepare for production release
|
2025-11-19 18:40:00 +01:00 |
|
|
mags0ft
|
40d4097799
|
fix several major bugs in startup script
|
2025-11-19 17:47:06 +01:00 |
|
|
mags0ft
|
3a8d2decfd
|
change project to work with llama.cpp instead of Ollama
|
2025-11-15 14:03:10 +01:00 |
|
|
SvenBrnn
|
3920146e31
|
change MODEL_NAME to OLLAMA_MODEL_NAME to prevent runpod from blocking deploy
|
2025-10-06 08:10:12 +02:00 |
|
|
Nicholas
|
51d38adcf3
|
Borrow vLLM concurrenccy logic a little.
|
2025-09-11 00:31:09 -05:00 |
|
|
SvenBrnnandGitHub
|
20c04140bc
|
Create tests.json
|
2025-05-27 07:49:00 +02:00 |
|
|
SvenBrnn
|
26384db5d1
|
remove tests for now and make model configurable
|
2025-05-23 06:53:59 +00:00 |
|
|
SvenBrnnandGitHub
|
b6654470ff
|
Create tests.json
|
2025-05-23 08:30:54 +02:00 |
|
|
SvenBrnnandGitHub
|
25eff19bee
|
Delete .runpod/tests.json
|
2025-05-23 08:22:53 +02:00 |
|
|
SvenBrnn
|
2a9f1a4882
|
move all code to root
|
2025-05-22 05:24:15 +00:00 |
|
|
SvenBrnn
|
b44de8fd6b
|
refactor for useage on runpod hub
|
2025-05-22 05:15:47 +00:00 |
|
|
SvenBrnn
|
3c0420b7b6
|
Fix tets
|
2025-05-22 04:57:49 +00:00 |
|
|
SvenBrnn
|
94e1abaa9e
|
Add runpod configs for hub
|
2025-05-22 04:53:14 +00:00 |
|