From: uvos Date: Thu, 23 Apr 2026 00:34:31 +0000 (+0200) Subject: HIP: flip GGML_HIP_GRAPHS to default on (#22254) X-Git-Tag: upstream/0.0.10438~1545 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=6217b49583432f55014c2a0551f453d42b300530;p=pkg%2Fggml%2Fsources%2Fllama.cpp HIP: flip GGML_HIP_GRAPHS to default on (#22254) In #11362 hip graph was disabled by default as, at the time, its performance impact was negative. Due to improvements in rocm and our usage and construction of graphs this is no longer true, so lets change the default. --- diff --git a/ggml/CMakeLists.txt b/ggml/CMakeLists.txt index 2effd587b..b9f7deb15 100644 --- a/ggml/CMakeLists.txt +++ b/ggml/CMakeLists.txt @@ -213,7 +213,7 @@ set (GGML_CUDA_COMPRESSION_MODE "size" CACHE STRING set_property(CACHE GGML_CUDA_COMPRESSION_MODE PROPERTY STRINGS "none;speed;balance;size") option(GGML_HIP "ggml: use HIP" OFF) -option(GGML_HIP_GRAPHS "ggml: use HIP graph, experimental, slow" OFF) +option(GGML_HIP_GRAPHS "ggml: use HIP graph" ON) option(GGML_HIP_RCCL "ggml: use ROCm Collective Comm. Library" OFF) option(GGML_HIP_NO_VMM "ggml: do not try to use HIP VMM" ON) option(GGML_HIP_ROCWMMA_FATTN "ggml: enable rocWMMA for FlashAttention" OFF)