refactor for useage on runpod hub
This commit is contained in:
@@ -38,7 +38,7 @@ jobs:
|
|||||||
password: ${{ secrets.DOCKERHUB_TOKEN }}
|
password: ${{ secrets.DOCKERHUB_TOKEN }}
|
||||||
- uses: docker/build-push-action@v6
|
- uses: docker/build-push-action@v6
|
||||||
with:
|
with:
|
||||||
context: ./wrapper
|
context: ./.runpod
|
||||||
build-args: OLLAMA_VERSION=${{ inputs.ollama_version }}
|
build-args: OLLAMA_VERSION=${{ inputs.ollama_version }}
|
||||||
push: true
|
push: true
|
||||||
tags: svenbrnn/runpod-ollama:${{ inputs.ollama_version }}${{ inputs.next_version_suffix }},svenbrnn/runpod-ollama:latest
|
tags: svenbrnn/runpod-ollama:${{ inputs.ollama_version }}${{ inputs.next_version_suffix }},svenbrnn/runpod-ollama:latest
|
||||||
|
|||||||
@@ -32,7 +32,7 @@ RUN apt-get update --yes --quiet && DEBIAN_FRONTEND=noninteractive apt-get insta
|
|||||||
WORKDIR /work
|
WORKDIR /work
|
||||||
|
|
||||||
# Add my src as /work
|
# Add my src as /work
|
||||||
ADD src /work
|
ADD engine.py handler.py requirements.txt start.sh test_input.json utils.py /work
|
||||||
|
|
||||||
# Set defaut ollama models directory to /runpod-volume where runpod will mount the volume by default
|
# Set defaut ollama models directory to /runpod-volume where runpod will mount the volume by default
|
||||||
ENV OLLAMA_MODELS="/runpod-volume"
|
ENV OLLAMA_MODELS="/runpod-volume"
|
||||||
@@ -37,4 +37,4 @@ else
|
|||||||
ollama pull $MODEL_NAME
|
ollama pull $MODEL_NAME
|
||||||
fi
|
fi
|
||||||
|
|
||||||
python -u runpod_wrapper.py $1
|
python -u handler.py $1
|
||||||
@@ -5,6 +5,8 @@
|
|||||||
Start a runpod serverless with the docker container ``svenbrnn/runpod-ollama:latest``. Set ``MODEL_NAME`` environment to a model from ollama.com to automatically download a model.
|
Start a runpod serverless with the docker container ``svenbrnn/runpod-ollama:latest``. Set ``MODEL_NAME`` environment to a model from ollama.com to automatically download a model.
|
||||||
A mounted volume will be automatically used.
|
A mounted volume will be automatically used.
|
||||||
|
|
||||||
|
[](https://www.runpod.io/console/hub/SvenBrnn/runpod-worker-ollama)
|
||||||
|
|
||||||
## Environment variables
|
## Environment variables
|
||||||
|
|
||||||
| Variable Name | Description | Default Value |
|
| Variable Name | Description | Default Value |
|
||||||
|
|||||||
Reference in New Issue
Block a user