]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
llava : add MobileVLM support (llama/5132)
authorJidongZhang-THU <redacted>
Wed, 31 Jan 2024 13:10:15 +0000 (21:10 +0800)
committerGeorgi Gerganov <redacted>
Sat, 10 Feb 2024 07:30:57 +0000 (09:30 +0200)
commitec6c92b639aba5bc324128200562ca78df5b5fea
treee0b056101fdd537d537912f65fa7d8256b34e888
parent6efea07c7ed77c7c09c4e31f78ad298400415fdf
llava : add MobileVLM support (llama/5132)

* New Feature:
    1. Sum_Rows:
        fix cuda kernel overflow
        fix block shape error when nrows too big
    2. Im2Col:
        Support Batch in cuda
        Support f32 to f32 both in cpu && cuda
    3. DepthWiseConv:
        Support by Im2Col && MulMat
    4. Pool_2d:
        Supoort avg pooling in cuda
    5. HardSigmoid:
        Imp in cuda
    6. HardSwish:
        Imp in cuda

* fix tabs instead of spaces

* code clean

* CUDA POOL2D

* ADD POOL2D test case in test-backend-ops.cpp

* code clean

* fix pool2d_kernel

nits

* fix bug in pool2d kernel

* fix avg pooling, count_include_pad

nits

* test-backend-ops : add more pool_2d tests

* cuda : fix warnings and formatting

* ggml : check types in release builds too in pool_2d

* test-backend-ops : remove f16 pool_2d tests

* cuda : more style fixes

* Add assert in ggml_cuda_op_pool2d

* pool2d float padding fallback

* test-backend-ops : add dst_type to im2col

---------

Co-authored-by: slaren <redacted>
include/ggml/ggml.h
src/ggml-cuda.cu
src/ggml.c
tests/test-backend-ops.cpp