由于 trendforge.devlive.top 访问受限,请切换到 trendforge.devlive.org 域名

rtx-3090

话题找到数量

JakeATX/llamAmpere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

304
37
44
+6
排名 #6
11月9日
查看详情
助手