From: Kawrakow Date: Mon, 12 Jun 2023 11:31:36 +0000 (+0300) Subject: metal : fix failure to load model (#1817) X-Git-Tag: gguf-v0.4.0~644 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=8c0a10e64dbf60fd9946c0cd5e6f59690800b123;p=pkg%2Fggml%2Fsources%2Fllama.cpp metal : fix failure to load model (#1817) The number of buffers in the ggml context was left unitialized. This leads to sporadic failures to load the model on startup. It is actually strange that the failure occurred so infrequantly. Co-authored-by: Iwan Kawrakow --- diff --git a/ggml-metal.m b/ggml-metal.m index 16a362fd..b73f51f2 100644 --- a/ggml-metal.m +++ b/ggml-metal.m @@ -86,6 +86,7 @@ struct ggml_metal_context * ggml_metal_init(void) { ctx->device = MTLCreateSystemDefaultDevice(); ctx->queue = [ctx->device newCommandQueue]; + ctx->n_buffers = 0; // determine if we can use MPS if (MPSSupportsMTLDevice(ctx->device)) {