git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

CUDA: MMQ code deduplication + iquant support (#8495)

* CUDA: MMQ code deduplication + iquant support

* 1 less parallel job for CI build

.github/workflows/build.yml		diff \| blob \| history
ggml/src/ggml-cuda/mmq.cu		diff \| blob \| history
ggml/src/ggml-cuda/mmq.cuh		diff \| blob \| history
ggml/src/ggml-cuda/template-instances/generate_cu_files.py		diff \| blob \| history
ggml/src/ggml-cuda/template-instances/mmq-instance-iq1_s.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/mmq-instance-iq2_s.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/mmq-instance-iq2_xs.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/mmq-instance-iq2_xxs.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/mmq-instance-iq3_s.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/mmq-instance-iq3_xxs.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/vecdotq.cuh		diff \| blob \| history

Packaging of ggml-org/llama.cpp