Removing dumb idea
This commit is contained in:
@@ -18,6 +18,8 @@ truecluster cluster --model Qwen/Qwen2.5-0.5B-Instruct --max-nodes 1 --quant fp1
|
||||
|
||||
## Run a node
|
||||
|
||||
Nodes download/resolve the cluster model from HuggingFace themselves and load only the assigned layer range.
|
||||
|
||||
```bash
|
||||
truecluster node --cluster-host 127.0.0.1 --cluster-port 7001 --device auto
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user