Simon Gardling 9baeaa5c23 llama-cpp: add grafana annotations for inference requests ...

Poll /slots endpoint, create annotations when slots start processing,
close with token count when complete. Includes NixOS VM test with
mock llama-cpp and grafana servers. Dashboard annotation entry added.

2026-04-02 17:43:49 -04:00

6.4 KiB

Raw Blame History

View Raw