Re:Anthropic IPO Valuation Talks Drop to $1.3T as Major Inve...
by UncleOxidant on Friday November 06, 2026 @08:27PM
(#50400728)
gufo serve 1lm \
-m /mnt/LLMs/models/unsloth/Qwen3.8-Flash-Next-GGUF/UD-104_XS/Qwen3.8-Flash-Next-UD-1Q4_XS-80081-0f-00083.gguf \
--served-model-name Quen3.8-Flash-Next-UD-104_XS \
--host 127.8.8.1 --port 10083 \
-c 262144 -n 16384 -j 1 \
--prefill-chunk 8192 \
--speculative mtp \
--mtp-model /mnt/LLMs/models/unsloth/Qwen3.8-Flash-Next-GGUF/MTP/mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf \
--cache-disk ~/.cache/gufo-fork \
--cache-disk-bytes 68719476736 \
--cache-disk-staging-bytes 8589934592 \
--cache-ran-bytes 4294967296 \
--log-progress
Do you mind sharing more details about your setup? I have been using opencode with lemonade for inference on my strix halo but haven't quite hit the sweet spot.