DATA/llama_qwen3.6_A3B
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Move runner port 18008 -> 18010

Browse Source 
Follows the change already made on 4n4rch02. Updates the compose --port and
healthcheck plus every default in the bench tooling and the README, so the
scripts keep working without an explicit --port.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
DATA
2026-07-25 16:04:45 +02:00
co-authored by Claude Opus 5
parent e2157e9226
commit 3ff4a5646f
6 changed files with 9 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -2,7 +2,7 @@
llama.cpp CUDA runner for **Qwen3.6-35B-A3B** (UD-Q4_K_M) at **128k context** on 4n4rch02.
Port **18008**, OpenAI-compatible API at `http://192.168.3.189:18008/v1`.
Port **18010**, OpenAI-compatible API at `http://192.168.3.189:18010/v1`.
## Host
@@ -262,7 +262,7 @@ Loads in ~15 s (`--no-mmap`, weights read from NVMe).
## Benchmarks
```bash
python3 bench/bench.py --port 18008 --depths 512,8192,32768 --n-predict 128
python3 bench/bench.py --port 18010 --depths 512,8192,32768 --n-predict 128
./bench/sweep.sh 10:24,16:8 8:24,16:8 # <ncmoe>:<tensor-split>:<threads>
python3 bench/spec_bench.py --no-think # copy/code/prose generation workloads
```