This repository has been archived on 2026-04-18. You can view files and clone it. You cannot open issues or pull requests or push a commit.

Simon Gardling 9baeaa5c23 llama-cpp: add grafana annotations for inference requests ...

Poll /slots endpoint, create annotations when slots start processing,
close with token count when complete. Includes NixOS VM test with
mock llama-cpp and grafana servers. Dashboard annotation entry added.

2026-04-02 17:43:49 -04:00

21 KiB

Raw Blame History

View Raw