]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml : use dynamic thread scheduling for matrix multiplication (#6915)
authorkunnis <redacted>
Wed, 15 May 2024 17:59:12 +0000 (12:59 -0500)
committerGitHub <redacted>
Wed, 15 May 2024 17:59:12 +0000 (19:59 +0200)
commite1b40ac3b94824d761b5e26ea1bc5692706029d9
treee9315e99443e5101d4639e60b7cd1cacb2408305
parentdc020985b8755dd6aa93a2f002f43c3ede808cce
ggml : use dynamic thread scheduling for matrix multiplication (#6915)

* Just reordering some structs.

* Adding in the calls to mm_pause

* Passing around the state

* Renaming and moving a bunch of variables around.

* Extracting the logic to it's own function.

* Moving some variable definitions into the chunk function.

* Moving some variables around

* moving src1_cont inside

* Moving row_size

* adding the current_chunk

* Reorg the code.

* Formatting to match the orig patch

* starting to setup the chunking variables

* Starting the buildup of the loop

* The yield shouldn't be necessary.

* adding the looping structure based on the chunk configuration.

* Add in the re-chunking code.

* Making it much more likely to rechunk.

* disable resizing if numa is enabled.

* Updating comments with what we've learned.

* Fix formatting

* Couple more formatting fixes.

* More style fixes.

* Fix Warnings

* Going with unused because there's conditional logic that needs it.

* Update ggml.c

* Update ggml.c

---------
ggml.c