Commit Graph

Select branches

Hide Pull Requests

master

v0.0.1-alpha

v0.0.2

v0.0.3

v0.0.4

v0.0.5

v0.0.6

v1.0.0

v1.0.1

v1.1.0

v1.1.1

v1.1.2

v1.2.0

v1.2.1

v1.2.2

v1.2.3

Mono Color

• 029f37afab pin dependencies v1.2.3 MagnusandGitHub 2026-06-14 18:03:54 +02:00
• 85c10953d6 add pseudo API key so the client doesn't raise an error MagnusandGitHub 2026-06-14 18:00:42 +02:00
• ea82e2a901 remove "inference" from title to make it more consistent with the other runpod repos on the hub MagnusandGitHub 2026-06-03 18:22:06 +02:00
• f890c50c8a Merge pull request #3 from cardinalfan1/claude/fix-runpod-startup-xxJqT v1.2.2 MagnusandGitHub 2026-06-03 18:12:26 +02:00
• dd2d52b5e3 Fix -m None passed to llama-server when cached model not found Claude 2026-04-15 19:34:58 +00:00
• 1196621d77 Merge pull request #1 from aparmar2000/patch-1 mags0ftandGitHub 2026-03-10 19:11:04 +01:00
• 3bcbee2d93 Update find_cached.py Ashan ParmarandGitHub 2026-02-20 18:04:59 -07:00
• b24c32c024 re-activate automatic testing v1.2.1 mags0ft 2026-02-12 08:45:54 +01:00
• c7b115bec0 fix typo in cached models docs mags0ftandGitHub 2026-02-11 02:14:18 +01:00
• c0d9682822 fixing issue with the requirements master owenqwenstarsky 2026-01-16 11:31:58 -06:00
• f7198bb06f fixing issue where when pulling cached model it wouldnt always find the path causing it to fail owenqwenstarsky 2026-01-16 11:22:42 -06:00
• 8a2982faa4 adjust incorrect llama-server start command log mags0ft 2025-12-27 23:51:00 +01:00
• d4ac091735 add timeout for llama-server startup to prevent indefinite waiting mags0ft 2025-12-27 18:00:58 +01:00
• 3d442d9123 add error handling for unexpected llama-server process exit v1.2.0 mags0ft 2025-12-26 14:51:06 +01:00
• 0c814177fe add caching support for models in start.sh and update documentation mags0ft 2025-12-26 14:49:03 +01:00
• 0a59d57025 rename tests.json temporarily to skip apparently buggy RunPod CI v1.1.2 mags0ft 2025-12-26 11:37:23 +01:00
• 398b59c0a1 update test timeout and default LLAMA_SERVER_CMD_ARGS for improved performance v1.1.1 mags0ft 2025-12-25 19:17:31 +01:00
• 889d3c5c96 move find_cached.py to src v1.1.0 mags0ft 2025-12-18 10:57:10 +01:00
• 41b3b3d02b add helper script to use cached models mags0ft 2025-12-18 10:50:33 +01:00
• a13d6c1b9f add issue note and fork explanation to README mags0ftandGitHub 2025-11-24 22:24:46 +01:00
• 403d318ffc update default args to include -ngl 99, improve startup sleep duration v1.0.1 mags0ft 2025-11-19 19:16:18 +01:00
• 381ed9ffff prepare for production release v1.0.0 mags0ft 2025-11-19 18:40:00 +01:00
• c42b80ebbd add default behavior for undefined LLAMA_SERVER_CMD_ARGS v0.0.6 mags0ft 2025-11-19 18:11:36 +01:00
• 40d4097799 fix several major bugs in startup script v0.0.5 mags0ft 2025-11-19 17:47:06 +01:00
• 36a8b32d1e fix: ensure script fails on error by setting 'set -e' v0.0.4 mags0ft 2025-11-15 16:07:54 +01:00
• 5f6c099504 further fixes for start.sh script v0.0.3 mags0ft 2025-11-15 15:15:17 +01:00
• be3de61c52 fix: correct logic for port validation in start.sh mags0ft 2025-11-15 15:02:05 +01:00
• 558da755c3 add empty handler.py file to mark repository as Runpod-compatible endpoint v0.0.2 mags0ft 2025-11-15 14:11:32 +01:00
• 9388fae14b add badge to README v0.0.1-alpha mags0ft 2025-11-15 14:07:00 +01:00
• 3a8d2decfd change project to work with llama.cpp instead of Ollama mags0ft 2025-11-15 14:03:10 +01:00
• d58239e290 chore: bump OLLAMA_VERSION to 0.12.11 github-actions[bot] 2025-11-14 08:31:45 +00:00
• 672b233f8d chore: bump OLLAMA_VERSION to 0.12.10 github-actions[bot] 2025-11-07 08:32:06 +00:00
• 20c2836294 chore: bump OLLAMA_VERSION to 0.12.9 github-actions[bot] 2025-11-02 08:26:29 +00:00
• b33647a947 chore: bump OLLAMA_VERSION to 0.12.8 github-actions[bot] 2025-11-01 08:27:14 +00:00
• 4d1c590077 chore: bump OLLAMA_VERSION to 0.12.7 github-actions[bot] 2025-10-30 08:30:47 +00:00
• 21bc109307 chore: bump OLLAMA_VERSION to 0.12.6 github-actions[bot] 2025-10-17 08:31:01 +00:00
• aa0b219f17 chore: bump OLLAMA_VERSION to 0.12.5 github-actions[bot] 2025-10-11 08:26:10 +00:00
• 3ef6d0bb62 fix pulling model name SvenBrnn 2025-10-06 09:13:08 +02:00
• 4bf93d6680 fix pulling model name SvenBrnn 2025-10-06 09:12:39 +02:00
• 3920146e31 change MODEL_NAME to OLLAMA_MODEL_NAME to prevent runpod from blocking deploy SvenBrnn 2025-10-06 08:10:12 +02:00
• 074e069cdd chore: bump OLLAMA_VERSION to 0.12.3 github-actions[bot] 2025-09-27 08:25:20 +00:00
• fddafc3d08 chore: bump OLLAMA_VERSION to 0.12.2 github-actions[bot] 2025-09-25 08:29:56 +00:00
• 2e49d8370c chore: bump OLLAMA_VERSION to 0.12.1 github-actions[bot] 2025-09-24 08:30:14 +00:00
• 93410b19be chore: bump OLLAMA_VERSION to 0.12.0 github-actions[bot] 2025-09-20 08:26:22 +00:00
• a89f6169ab chore: bump OLLAMA_VERSION to 0.11.11 github-actions[bot] 2025-09-16 08:30:28 +00:00
• 10d0941e6f Merge pull request #3 from seurimas/master SvenBrnnandGitHub 2025-09-14 09:48:58 +02:00
• 51d38adcf3 Borrow vLLM concurrenccy logic a little. Nicholas 2025-09-10 22:05:01 -05:00
• 0df1db40e3 chore: bump OLLAMA_VERSION to 0.11.10 github-actions[bot] 2025-09-05 08:29:16 +00:00
• 861093b09a chore: bump OLLAMA_VERSION to 0.11.9 github-actions[bot] 2025-09-04 08:28:50 +00:00
• 034257b65f chore: bump OLLAMA_VERSION to 0.11.8 github-actions[bot] 2025-08-29 08:29:38 +00:00
• 26a950daa6 chore: bump OLLAMA_VERSION to 0.11.7 github-actions[bot] 2025-08-26 08:32:11 +00:00
• 4cf7821528 chore: bump OLLAMA_VERSION to 0.11.6 github-actions[bot] 2025-08-21 08:30:22 +00:00
• 38341b51f6 chore: bump OLLAMA_VERSION to 0.11.5 github-actions[bot] 2025-08-20 08:31:03 +00:00
• 3a2bc46d3e chore: bump OLLAMA_VERSION to 0.11.4 github-actions[bot] 2025-08-08 08:34:56 +00:00
• 4711797048 chore: bump OLLAMA_VERSION to 0.11.3 github-actions[bot] 2025-08-07 08:35:19 +00:00
• 2bf10da0aa chore: bump OLLAMA_VERSION to 0.11.2 github-actions[bot] 2025-08-06 08:35:20 +00:00
• 66db7aec78 chore: bump OLLAMA_VERSION to 0.10.1 github-actions[bot] 2025-07-31 08:35:20 +00:00
• a46a35f218 fix build SvenBrnn 2025-07-13 17:45:30 +02:00
• a4372a1658 chore: bump OLLAMA_VERSION to 0.9.6 github-actions[bot] 2025-07-09 08:32:25 +00:00
• e0e591d376 chore: bump OLLAMA_VERSION to 0.9.5 github-actions[bot] 2025-07-03 08:31:49 +00:00
• 4895e399e7 chore: bump OLLAMA_VERSION to 0.9.4 github-actions[bot] 2025-06-26 08:32:27 +00:00
• 8c9cf428cd chore: bump OLLAMA_VERSION to 0.9.2 github-actions[bot] 2025-06-18 08:31:48 +00:00
• f3bdb2be86 chore: bump OLLAMA_VERSION to 0.9.1 github-actions[bot] 2025-06-06 08:30:34 +00:00
• 3b98fb21b4 Update check-n8n-new-release.yml SvenBrnnandGitHub 2025-05-30 09:09:16 +02:00
• e1c3899852 Update check-n8n-new-release.yml SvenBrnnandGitHub 2025-05-30 09:05:58 +02:00
• 4db7c37a72 Update create-new-release-on-push.yml SvenBrnnandGitHub 2025-05-30 09:05:43 +02:00
• 49e7a1d2cd Update create-new-release-on-push.yml SvenBrnnandGitHub 2025-05-30 09:03:24 +02:00
• d8c0c1b5db Update check-n8n-new-release.yml SvenBrnnandGitHub 2025-05-30 09:00:13 +02:00
• 42606c808c chore: bump OLLAMA_VERSION to 0.9.0 github-actions[bot] 2025-05-30 06:57:53 +00:00
• 36785bc6e0 Update check-n8n-new-release.yml SvenBrnnandGitHub 2025-05-30 08:57:04 +02:00
• 20c04140bc Create tests.json SvenBrnnandGitHub 2025-05-27 07:49:00 +02:00
• e323f16526 fix github action for versioning SvenBrnn 2025-05-23 07:04:22 +00:00
• 26384db5d1 remove tests for now and make model configurable SvenBrnn 2025-05-23 06:53:59 +00:00
• b6654470ff Create tests.json SvenBrnnandGitHub 2025-05-23 08:30:54 +02:00
• 25eff19bee Delete .runpod/tests.json SvenBrnnandGitHub 2025-05-23 08:22:53 +02:00
• f6877905f5 Move files around again SvenBrnn 2025-05-22 05:36:18 +00:00
• 2a9f1a4882 move all code to root SvenBrnn 2025-05-22 05:24:15 +00:00
• b44de8fd6b refactor for useage on runpod hub SvenBrnn 2025-05-22 05:15:47 +00:00
• 3c0420b7b6 Fix tets SvenBrnn 2025-05-22 04:57:49 +00:00
• 94e1abaa9e Add runpod configs for hub SvenBrnn 2025-05-22 04:53:14 +00:00
• 6ace719082 Update create-new-release-on-push.yml SvenBrnnandGitHub 2025-03-20 21:27:00 +01:00
• 224ac3d3b2 Update check-n8n-new-release.yml SvenBrnnandGitHub 2025-03-20 21:26:25 +01:00
• 4919f0c1a9 Add symlink for python3 in Dockerfile SvenBrnn 2025-03-19 13:46:00 +01:00
• f9b1f7850d Update Dockerfile and README for latest image version SvenBrnn 2025-03-19 13:37:48 +01:00
• 75db604b5a Update Dockerfile and README for latest image version SvenBrnn 2025-03-19 13:32:58 +01:00
• e308e89f1f Update build context for Docker build and push action SvenBrnn 2025-03-19 13:14:25 +01:00
• a3e33a1333 Update build context for Docker build and push action SvenBrnn 2025-03-19 13:14:25 +01:00
• 5ff2642167 Add auto-building SvenBrnn 2025-03-19 12:34:57 +01:00
• df9f59ffb1 Let more then one model beeing pushed SvenBrnn 2025-01-24 12:09:39 +00:00
• a3641d7d00 Add instructions for embeding a model SvenBrnn 2025-01-18 18:22:04 +01:00
• 58e2fa3b04 Update readme SvenBrnn 2025-01-18 18:04:22 +01:00
• 1462e142c9 Initial commit SvenBrnn 2025-01-18 18:01:22 +01:00