titaniumtown/server-config
Archived
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

llama-cpp: adjust args
All checks were successful
Build and Deploy / deploy (push) Successful in 2m32s

Browse Source
This commit is contained in:
Simon Gardling
2026-04-02 16:09:17 -04:00
parent bb6ea2f1d5
commit 50453cf0b5
1 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
services/llama-cpp.nix
View File

@@ -22,11 +22,13 @@
# "-ngl" # "-ngl"
# "12" # "12"
"-c" "-c"
"16384" "32768"
"-ctk" "-ctk"
"q8_0" "q8_0"
"-ctv" "-ctv"
"turbo3" "turbo4"
"-fa"
"on"
]; ];
}; };