From: Kawrakow Date: Mon, 12 Jun 2023 11:31:36 +0000 (+0300) Subject: metal : fix failure to load model (#1817) X-Git-Tag: gguf-v0.4.0~644 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=8c0a10e64dbf60fd9946c0cd5e6f59690800b123;p=pkg%2Fggml%2Fsources%2Fllama.cpp metal : fix failure to load model (#1817) The number of buffers in the ggml context was left unitialized. This leads to sporadic failures to load the model on startup. It is actually strange that the failure occurred so infrequantly. Co-authored-by: Iwan Kawrakow --- diff --git a/ggml-metal.m b/ggml-metal.m index 16a362fd7..b73f51f24 100644 --- a/ggml-metal.m +++ b/ggml-metal.m @@ -86,6 +86,7 @@ struct ggml_metal_context * ggml_metal_init(void) { ctx->device = MTLCreateSystemDefaultDevice(); ctx->queue = [ctx->device newCommandQueue]; + ctx->n_buffers = 0; // determine if we can use MPS if (MPSSupportsMTLDevice(ctx->device)) {