2 Commits

Include renames

Author	SHA1	Message	Date
DATAandClaude Opus 5	3ff4a5646f	Move runner port 18008 -> 18010 ... Follows the change already made on 4n4rch02. Updates the compose --port and healthcheck plus every default in the bench tooling and the README, so the scripts keep working without an explicit --port. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>	2026-07-25 16:04:45 +02:00
DATAandClaude Opus 5	f628eedbaa	Measure speculative decoding: all ngram modes lose to plain decoding ... Verifying a K-token draft costs ~K times the CPU expert work, because each token routes to its own 8-of-256 experts and nothing is amortized. The loss is largest on structured code output (-51% for ngram-simple), i.e. exactly where speculation should have won. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>	2026-07-25 13:54:08 +02:00