This website requires JavaScript.
Explore
Help
Sign In
owen
/
inference-worker
Watch
1
Star
0
Fork
0
Code
Issues
Pull Requests
Packages
Projects
Releases
Wiki
Activity
Files
20c2836294b57628396c77dd0bf6ea4b1923b212
inference-worker
/
src
T
History
SvenBrnn
3ef6d0bb62
fix pulling model name
2025-10-06 09:13:08 +02:00
..
engine.py
change MODEL_NAME to OLLAMA_MODEL_NAME to prevent runpod from blocking deploy
2025-10-06 08:10:12 +02:00
handler.py
Borrow vLLM concurrenccy logic a little.
2025-09-11 00:31:09 -05:00
requirements.txt
Move files around again
2025-05-22 05:36:28 +00:00
start.sh
fix pulling model name
2025-10-06 09:13:08 +02:00
test_input.json
Move files around again
2025-05-22 05:36:28 +00:00
utils.py
Move files around again
2025-05-22 05:36:28 +00:00