update readmes on TRANSFORMERS_VERSION

This commit is contained in:
velaraptor-runpod
2026-04-06 16:54:08 -05:00
parent 6fbd480a26
commit c979f0020f
2 changed files with 7 additions and 0 deletions
+3
View File
@@ -32,6 +32,9 @@ All behaviour is controlled through environment variables:
For complete configuration options, see the [full configuration documentation](https://github.com/runpod-workers/worker-vllm/blob/main/docs/configuration.md).
### Specify Transformers Version
To change the version of the [Transformers library](https://github.com/huggingface/transformers) use the `TRANSFORMERS_VERSION` environment variable to specify the version you want to use. Note this might break the handler, so use for development purposes.
## API Usage
This worker supports two API formats: **RunPod native** and **OpenAI-compatible**.
+4
View File
@@ -77,6 +77,10 @@ Any env var whose name matches a valid `AsyncEngineArgs` field (uppercased) is a
For the complete list of all available environment variables, examples, and detailed descriptions: **[Configuration](docs/configuration.md)**
### Specify Transformers Version
To change the version of the [Transformers library](https://github.com/huggingface/transformers) use the `TRANSFORMERS_VERSION` environment variable to specify the version you want to use. Note this might break the handler, so use for development purposes.
## Option 2: Build Docker Image with Model Inside
To build an image with the model baked in, you must specify the following docker arguments when building the image.