server-config

Archived

Author	SHA1	Message	Date
Simon Gardling	479ec43b8f	llama-cpp: integrate native prometheus /metrics endpoint llama.cpp server has a built-in /metrics endpoint exposing prompt_tokens_seconds, predicted_tokens_seconds, tokens_predicted_total, n_decode_total, and n_busy_slots_per_decode. Enable it with --metrics and add a Prometheus scrape target, replacing the need for any external metric collection for LLM inference monitoring.	2026-04-03 15:19:11 -04:00
Simon Gardling	47aeb58f7a	llama-cpp: do logging All checks were successful Build and Deploy / deploy (push) Successful in 2m27s	2026-04-03 14:39:46 -04:00
Simon Gardling	d4d01d63f1	llama-cpp: update + re-enable + gemma 4 E4B Some checks failed Build and Deploy / deploy (push) Failing after 20m16s	2026-04-03 14:06:35 -04:00
Simon Gardling	124d33963e	organize All checks were successful Build and Deploy / deploy (push) Successful in 2m43s	2026-04-03 00:47:12 -04:00