]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 244776a)
Add python example w/ cffi-generated bindings
authorochafik <redacted>
Sun, 13 Aug 2023 16:37:03 +0000 (17:37 +0100)
committerochafik <redacted>
Sun, 13 Aug 2023 19:05:13 +0000 (20:05 +0100)
commit53a0003018828bd4094cd4f67009d9df7bb18669
tree10a4f44ec0d1545f56d7034366386bf2dde888d5tree
parent244776a089ebed7f0332f9c8bdc38d2d40464493commit | diff
Add python example w/ cffi-generated bindings

Add python example w/ cffi-generated bindings

Features:

- Seamless copies between tensors (ggml & numpy alike) with automatic (de/re)quantization
- Access to full C API (incl. CUDA, MPI, OpenCL, Metal, alloc... and any local API changes)
- Trivial regeneration with `python regenerate.py` (uses llama.cpp headers by default, README.md for options)
.gitignore diff | blob | history
examples/python/README.md [new file with mode: 0644] blob
examples/python/api.h [new file with mode: 0644] blob
examples/python/example_add_quant.py [new file with mode: 0644] blob
examples/python/example_test_all_quants.py [new file with mode: 0644] blob
examples/python/ggml/__init__.py [new file with mode: 0644] blob
examples/python/ggml/cffi.py [new file with mode: 0644] blob
examples/python/ggml/utils.py [new file with mode: 0644] blob
examples/python/regenerate.py [new file with mode: 0644] blob
Packaging of ggml-org/ggml