From: Georgi Gerganov Date: Sun, 26 Jan 2025 12:30:15 +0000 (+0200) Subject: readme : update hot topics X-Git-Tag: upstream/0.0.4631~73 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=2cc9b8c32c78d09cd1b4df0aaa605ab2d0176243;p=pkg%2Fggml%2Fsources%2Fllama.cpp readme : update hot topics --- diff --git a/README.md b/README.md index 97d02867..ff853677 100644 --- a/README.md +++ b/README.md @@ -16,6 +16,7 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others) ## Hot topics +- **How to use [MTLResidencySet](https://developer.apple.com/documentation/metal/mtlresidencyset?language=objc) to keep the GPU memory active?** https://github.com/ggerganov/llama.cpp/pull/11427 - **VS Code extension for FIM completions:** https://github.com/ggml-org/llama.vscode - Vim/Neovim plugin for FIM completions: https://github.com/ggml-org/llama.vim - Introducing GGUF-my-LoRA https://github.com/ggerganov/llama.cpp/discussions/10123