titaniumtown/nixos
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

llama-cpp: context: 32768 -> 65536

Browse Source
This commit is contained in:
Simon Gardling
2026-04-06 01:04:23 -04:00
parent 0e4f0d3176
commit 8fddd3a954
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
services/llama-cpp/llama-cpp.nix
View File

@@ -28,7 +28,7 @@ in
# "-ngl" # "-ngl"
# "12" # "12"
"-c" "-c"
"32768" "65536"
"-ctk" "-ctk"
"q8_0" "q8_0"
"-ctv" "-ctv"