返回资讯中心
外部精选
软件工程
#社区热议

ggml 发布 v1.0.0,移除废弃 API 并新增 FP8 支持

来源标题:Ggml v1.0.0

ggml 发布 v1.0.0,清理了废弃的公开 API 和旧版 DIAG_MASK 算子,并新增可配置的 YaRN 截断与 FP8 支持。性能方面,CUDA/Metal 加入少行量化矩阵乘与 MoE 融合,Vulkan 新增 prefill FlashAttention 路径,SYCL 引入设备端 MoE 调度器。OpenCL 为 Adreno 拆解 FlashAttention,WebGPU 也新增了内核。

Hacker Newscobychapple2026/11/14 · 今天25 分钟阅读

以下正文由 AI 翻译自 Hacker News(原文版权归原站所有),可能存在偏差,重要内容请以原文为准。

ggml 1.0.0 精简了废弃的公开 API 和旧的 DIAG_MASK 算子,新增可配置的 YaRN 截断和 FP8 支持,并在各后端带来大量性能优化:CUDA/Metal 上的少行量化矩阵乘与 MoE 融合、Vulkan 的 prefill FlashAttention 路径、SYCL 的设备端 MoE 调度器、OpenCL 中针对 Adreno 的分解式 FlashAttention、新的 WebGPU kernel、扩展的 Hexagon 算子覆盖,以及避免上传未使用输入的调度器改进。

417a024 ggml : bump version to 1.0.0 (#1690) 771b3d9 requirements : fix numpy for python 3.14 (#1691) f154959 sync : llama.cpp ec04faf fix(hexagon): make host build work with clang-cl on Windows ARM64 (llama/32011) b45738e examples : adapt to removal of ggml_diag_mask_inf 1514439 sync : llama.cpp 5f29555 ggml : prune (llama/29801) 076861c hexagon: add Q5_0 and Q5_1 support (llama/32094) 63ec52d Title: CUDA: few-row MMQ for BS 2-24 (llama/31533) c6fe796 ggml : route GATED_DELTA_NET to the SpacemiT RVV kernel (llama/31897) 4ae6e72 vulkan : Intel FA kernel for prefill. (llama/29357) b22071c ggml-cpu: use the 4x4 simd_gemm tile on ARM NEON (llama/32128) ba8b013 CUDA: Optimize prefil via fuse of w_s scale in epilogue MMQ for nvfp4 checkpoints (llama/26048) 05f605a ggml-backend : prefetch only inputs computed by earlier splits (llama/32100) b8a5b87 ggml : dispatch SpacemiT Q4_1 32x256 through the HP kernel (llama/31929) 7a8cef5 sycl: make oneDNN FA cache thread-safe and memoize runtime failures (llama/31138) 6dfea1a sycl : fix AOT for more than 4GB (llama/31873) 012ff44 sycl : use cached device-id in set_main_device (llama/32013) 2f9d47b CUDA: add cuda debug buffer pool (llama/31919) 522d257 opencl: add bin kernel kernel_gemm_noshuffle_q4_0_f32_32b_trans_ila_a7_bin (llama/30947) 0f9dcb7 CUDA: skip empty MoE tiles in MMQ stream-k fixup (llama/32067) 6bed9a8 opencl: add decomposed FA for Adreno (llama/32046) a357e7b metal : prevent out-of-bounds reads in SOLVE_TRI kernel (llama/32103) c36ccd8 vulkan: support batched tensor copy API (llama/31418) 1bffc59 backend : re-instantiate CUDA graphs when the cluster dims of a kernel change (llama/31284) 8153155 ROCm/HIP: fixed BLAS workspace instead of rocBLAS allocating one per call (llama/31838) ad7d200 cpu: accumulate flash attention V in F32 (llama/29810) 7f4a2db webgpu: add PAD_REFLECT_1D support (llama/31877) 0f51454 vulkan: allow dequantized KV optimization with CM2 (llama/31526) eb4de49 vulkan: allocate the device fault vendor binary buffer (llama/32008) 6b7f47a cuda : use MMVF for BF16 matrices of few rows at small batch sizes (llama/31959) 77d01f1 cuda : add sm70 FlashAttention config case for DKQ=256, DV=256, ncols=64 (llama/27997) bd37ba0 cuda : fattn mma head sizes 40 72 (llama/30285) 161ca15 CUDA: Add OCP FP8 support (llama/28413) 06faf80 sycl : fixed sycl CLAMP to actually support strided view (llama/31784) a986181 cuda : remove unused ids and type_src0 parameters (llama/32018) 55104b2 llama : Add FP8 KV-cache support (llama/28392) 0753641 ggml : add MUL_MAT src1 precision tests and gating (llama/31896) 1cd16bd cuda : remove unused quantize_cuda_t typedef (llama/31884) 4a18cdd cuda : halve VMM pool reservation size and retry on cuMemAddressReserve failure (llama/30542) 1c9ac9d CUDA: skip graph compat check when graph is being reused (llama/32004) 999c725 ggml : fix FreeBSD Vulkan build by setting _XOPEN_SOURCE=700 (llama/31701) 47bc1d8 CUDA: move graph and concurrent stream state out of common.cuh (llama/32001) df70e12 cann: fail early when checking if buffer type is supported (llama/31270) e447eb5 sycl: Add device-side MoE scheduler (llama/30156) 9a1c582 vulkan: add tiled-transpose concat shader for Qwen models (llama/30591) 8b3c8cf ggml-rpc : fail gracefully on unreachable endpoints and failed handshakes (llama/30415) f860f1d vulkan: Divide GROUP_NORM workgroup to 2D to avoid maxComputeWorkGroupCount limit (llama/31930) eb5571a vulkan: Fix out of bounds reads/writes on MoltenVK (llama/31890) 5a9a264 vulkan: cap scalar flash attention at 8 rows for large heads on Qualcomm (llama/30829) 5610f41 sycl: un-gate oneDNN fused SDPA for Alchemist at head_dim=64 (llama/31574) 487cadf hexagon: fix 64-bit FastRPC handle truncation on close (llama/30952) be37c9c ggml-zdnn: accept non-zdnn tensors, invalidate compute tensors after every op (llama/31824) 294d5fc ggml : implement the backward pass for TRI (llama/30712) e18c2c6 ggml-backend: don't upload inputs that are not read (llama/31419) e84d36b metal : prevent out-of-bounds writes to the Metal FA output buffer (llama/31662) 0dd184f metal : make ggml_tri select instead of scaling by the comparison (llama/30711) b6d482c opencl : include climits (llama/31935) 62de780 RPC: Improve loading times (llama/29413) a7276d0 ggml : support YaRN truncation config on openvino, sycl, vulkan, webgpu, rpc (llama/30802) da89459 sycl: cache device-id (llama/31126) fb57085 tests: bound the test_rope tolerance by the f32 angle resolution (llama/31874) e43d847 opencl: add f32 MUL_MAT_ID (llama/31783) d1c1e4b ggml-zdnn: fix release binary not detecting backend lib (llama/31905) 7e7b6e9 mtmd: refactoring: remove clip.h, consolidate code into mtmd (llama/31865) 5a0e536 cpu: enable SpacemiT IME2 MXFP4 dense repack (llama/31776) 7f4b25f llamafile: impl bf16 and q8_0 vxe (llama/31866) f22fc6a ggml : update CUDA/Metal radix Top-K to make tied selections deterministic (llama/31084) 47b8b4f ggml-cuda : add d_state=64 fast path to SSM_SCAN kernel (llama/31818)

(原文较长,此处译出前 6000 字,完整内容请点「打开原文」。)

正文由 探How 从来源站点 RSS 同步,内容未经改写;遇到排版缺失或需要图片、视频时请以原文为准。

打开原文
去社区讨论 →