]>
git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/log
Georgi Gerganov [Fri, 16 Dec 2022 16:01:05 +0000 (18:01 +0200)]
Update README.md (#56)
Georgi Gerganov [Fri, 16 Dec 2022 16:00:12 +0000 (18:00 +0200)]
ggml : make more compatible with c99 (#262)
Georgi Gerganov [Thu, 15 Dec 2022 18:38:08 +0000 (20:38 +0200)]
Update README.md
Georgi Gerganov [Thu, 15 Dec 2022 18:15:36 +0000 (20:15 +0200)]
stream : fix build
Georgi Gerganov [Thu, 15 Dec 2022 16:28:22 +0000 (18:28 +0200)]
stream : add sliding window mode
Georgi Gerganov [Tue, 13 Dec 2022 21:13:55 +0000 (23:13 +0200)]
whisper : fix UB when reading buffer of length 0 bytes (#265)
Georgi Gerganov [Tue, 13 Dec 2022 21:09:01 +0000 (23:09 +0200)]
ggml : fix indentation
Georgi Gerganov [Tue, 13 Dec 2022 21:07:49 +0000 (23:07 +0200)]
ggml : make compatible with c99 (#262)
Georgi Gerganov [Mon, 12 Dec 2022 21:44:36 +0000 (23:44 +0200)]
talk : improve prompting
Georgi Gerganov [Mon, 12 Dec 2022 18:36:52 +0000 (20:36 +0200)]
release : v1.0.3
Fixed whisper.spm tests
Georgi Gerganov [Mon, 12 Dec 2022 18:33:09 +0000 (20:33 +0200)]
Update README.md
Georgi Gerganov [Mon, 12 Dec 2022 18:25:56 +0000 (20:25 +0200)]
release : v1.0.2
Georgi Gerganov [Mon, 12 Dec 2022 18:23:10 +0000 (20:23 +0200)]
Update README.md
Georgi Gerganov [Mon, 12 Dec 2022 18:20:51 +0000 (20:20 +0200)]
Update README.md
Georgi Gerganov [Mon, 12 Dec 2022 18:17:27 +0000 (20:17 +0200)]
Node.js package (#260)
* npm : preparing infra for node package
* npm : package infra ready
* npm : initial version ready
* npm : change name to whisper.cpp
whisper.js is taken
Georgi Gerganov [Sun, 11 Dec 2022 18:34:04 +0000 (20:34 +0200)]
talk : make compatible with c++11 (part 2)
Georgi Gerganov [Sun, 11 Dec 2022 18:19:17 +0000 (20:19 +0200)]
talk : make compatible with c++11
Georgi Gerganov [Sun, 11 Dec 2022 18:04:05 +0000 (20:04 +0200)]
cmake : require c++11 instead of c++20
Roland Rabien [Sun, 11 Dec 2022 18:03:07 +0000 (10:03 -0800)]
Remove C++20 requirement (#257)
* Remove C++20 requirement
* Roll back C features not supported in VS2017
Lexevolution [Sun, 11 Dec 2022 18:00:29 +0000 (04:00 +1000)]
Add newline per segment for text output (#254)
Georgi Gerganov [Sun, 11 Dec 2022 09:56:13 +0000 (11:56 +0200)]
bench : more concise representation of the results (#89)
Georgi Gerganov [Sun, 11 Dec 2022 09:39:46 +0000 (11:39 +0200)]
minor : fix .gitignore to not ignore examples
Georgi Gerganov [Sun, 11 Dec 2022 09:09:01 +0000 (11:09 +0200)]
bench.wasm : same as "bench" but runs in the browser (#89)
Georgi Gerganov [Sat, 10 Dec 2022 14:54:57 +0000 (16:54 +0200)]
Update README.md
Georgi Gerganov [Sat, 10 Dec 2022 14:48:15 +0000 (16:48 +0200)]
talk : fix build for MSVC
Georgi Gerganov [Fri, 9 Dec 2022 18:38:10 +0000 (20:38 +0200)]
talk : talk with AI in the terminal
bert hubert [Sat, 10 Dec 2022 12:09:31 +0000 (13:09 +0100)]
fix potential bug reading model data into a small size optimized string which could lead to memory corruption. In an SSO string, you can't write data to &str[0] and expect it to work well.
Also added a small wrapper function to more safely read model data without having to get the sizeof right. I tested this on tiny, base and large models, there was no change in behaviour.
Georgi Gerganov [Sat, 10 Dec 2022 11:38:26 +0000 (13:38 +0200)]
whisper : minor improvemnt in decoding strategy (#244)
Do not allow for text segments to go beyond end of audio.
This partially mitigates some issues when the last audio window is 1-2
seconds just before the end of the audio file and the decoding spirals
into a repetition of the last transcribed phrase.
Georgi Gerganov [Thu, 8 Dec 2022 21:48:04 +0000 (23:48 +0200)]
ggml : add alternative cblas_sgemm call
Georgi Gerganov [Thu, 8 Dec 2022 17:42:06 +0000 (19:42 +0200)]
make : indentation + .gitignore
Reinis Muiznieks [Wed, 7 Dec 2022 12:44:58 +0000 (14:44 +0200)]
Flag for Position Independent Code
Georgi Gerganov [Thu, 8 Dec 2022 17:17:24 +0000 (19:17 +0200)]
twitch.sh : various fixes and polishing
- check if streamlink is installed
- fix audio chunking
- change default threads to 4
keyehzy [Thu, 8 Dec 2022 02:45:54 +0000 (23:45 -0300)]
Allow for Twitch.tv live transcription
We rely on streamlink library to give us a stream, then we proceed similarly to
the radio livestream example.
Kartik Saranathan [Thu, 8 Dec 2022 04:18:30 +0000 (23:18 -0500)]
Fix paths echoed after the download
Was using models path instead of root path
Al Hoang [Thu, 8 Dec 2022 05:34:19 +0000 (05:34 +0000)]
fix compilation on haiku
Georgi Gerganov [Wed, 7 Dec 2022 20:12:08 +0000 (22:12 +0200)]
yt-wsp.sh : improve usage instructions
Georgi Gerganov [Wed, 7 Dec 2022 19:12:55 +0000 (21:12 +0200)]
yt-wsp.sh : fix usage instruction + comment
Georgi Gerganov [Wed, 7 Dec 2022 03:15:46 +0000 (05:15 +0200)]
Update README.md
Georgi Gerganov [Wed, 7 Dec 2022 02:41:43 +0000 (04:41 +0200)]
livestream.sh : remove obsolete comment
Georgi Gerganov [Tue, 6 Dec 2022 20:12:57 +0000 (22:12 +0200)]
ggml : fix typo in previous commit
Georgi Gerganov [Tue, 6 Dec 2022 20:05:33 +0000 (22:05 +0200)]
ggml : use macros to inline FP16 <-> FP32 conversions
Georgi Gerganov [Tue, 6 Dec 2022 19:56:56 +0000 (21:56 +0200)]
ggml : add F16C CPU flag check
katsu560 [Tue, 6 Dec 2022 18:32:48 +0000 (03:32 +0900)]
add fp16/fp32 convert intrinsics
Georgi Gerganov [Tue, 6 Dec 2022 16:48:57 +0000 (18:48 +0200)]
models : add the new "large" model release by OpenAI
The old "large" model is now renamed "large-v1".
If you have been using it, make sure to rename it and download the new
"large" model for best results.
Georgi Gerganov [Tue, 6 Dec 2022 16:47:48 +0000 (18:47 +0200)]
bench : add commit hash to bench-all.sh results
Georgi Gerganov [Fri, 2 Dec 2022 19:51:50 +0000 (21:51 +0200)]
Try to improve the token sampling strategy (#193)
* whisper : try to improve the token sampling strategy
- Add the "max_initial_timestaamp" token logic from OpenAI
- Disallow sampling timestamps that are in the past
* whisper : fix the max initial timestamp logic + fallback decoding
Georgi Gerganov [Mon, 28 Nov 2022 20:44:01 +0000 (22:44 +0200)]
tests : adding transcription tests
Georgi Gerganov [Thu, 1 Dec 2022 20:15:12 +0000 (22:15 +0200)]
ggml : remove inline specifier from fp16 <-> fp32 converters
Georgi Gerganov [Thu, 1 Dec 2022 18:49:09 +0000 (20:49 +0200)]
livestream : handle ffmpeg errors gracefully and stabilize transcript
Georgi Gerganov [Thu, 1 Dec 2022 17:47:58 +0000 (19:47 +0200)]
livestream : minor changes
semiformal-net [Thu, 1 Dec 2022 17:18:22 +0000 (12:18 -0500)]
livestream : fix losing words across audio chunk (#195)
* improve livestream script
* Update examples/livestream.sh
Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: Paul Edwards <redacted>
Co-authored-by: Georgi Gerganov <redacted>
Tienshiao Ma [Tue, 29 Nov 2022 07:29:34 +0000 (23:29 -0800)]
Fix Darwin flags - was incorrectly always using the Linux else clause
Georgi Gerganov [Sun, 27 Nov 2022 18:28:36 +0000 (20:28 +0200)]
whisper : add mechanism for aborting the whisper_full() computation
Georgi Gerganov [Sun, 27 Nov 2022 09:30:32 +0000 (11:30 +0200)]
Update README.md
Georgi Gerganov [Sun, 27 Nov 2022 08:48:59 +0000 (10:48 +0200)]
whisper.objc : fix context + broken readme links
Georgi Gerganov [Sat, 26 Nov 2022 15:28:28 +0000 (17:28 +0200)]
whisper.objc : add real-time processing (#97)
Similar to the "stream" app
Georgi Gerganov [Sat, 26 Nov 2022 14:27:04 +0000 (16:27 +0200)]
whisper.objc : fix build warnings
Georgi Gerganov [Sat, 26 Nov 2022 11:07:54 +0000 (13:07 +0200)]
minor : remove "examples/" prefix from the README
Georgi Gerganov [Sat, 26 Nov 2022 10:53:23 +0000 (12:53 +0200)]
yt-wsp.sh : script to easily transcribe VODs
Thanks to @DaniruKun
ref: https://gist.github.com/DaniruKun/
96f763ec1a037cc92fe1a059b643b818
Usage:
cd whisper.cpp
make
./examples/yt-wsp.sh <video-url>
Georgi Gerganov [Sat, 26 Nov 2022 09:56:55 +0000 (11:56 +0200)]
Update README.md
Georgi Gerganov [Sat, 26 Nov 2022 09:40:06 +0000 (11:40 +0200)]
command.wasm : add voice assistant example for the Web (#171)
Same as the command-line tool "command", but runs in the browser
Also, added helper script "extra/deploy-wasm.sh" and fixed some timing
constants for the WASM examples.
Georgi Gerganov [Sat, 26 Nov 2022 08:22:42 +0000 (10:22 +0200)]
minor : add comment for using "generate_karaoke.sh"
Georgi Gerganov [Sat, 26 Nov 2022 08:05:37 +0000 (10:05 +0200)]
livestream.sh : simple tool to transcribe audio livestreams (#185)
Georgi Gerganov [Fri, 25 Nov 2022 21:57:46 +0000 (23:57 +0200)]
stream.wasm : add web-based real-time transcription (#112)
Georgi Gerganov [Fri, 25 Nov 2022 21:07:42 +0000 (23:07 +0200)]
whisper.wasm : do not block page while processing (close #86)
Georgi Gerganov [Fri, 25 Nov 2022 20:08:58 +0000 (22:08 +0200)]
main : add stereo-channel-based diarization (#64)
Not tested - I don't have stereo dialog audio
Georgi Gerganov [Fri, 25 Nov 2022 18:23:58 +0000 (20:23 +0200)]
command : add demonstration video
Georgi Gerganov [Fri, 25 Nov 2022 17:53:50 +0000 (19:53 +0200)]
command : fix build + fix README + add bold printing
Georgi Gerganov [Fri, 25 Nov 2022 17:06:56 +0000 (19:06 +0200)]
examples : add "command" tool (#171)
Georgi Gerganov [Fri, 25 Nov 2022 17:08:51 +0000 (19:08 +0200)]
refactoring : more readable code
vicalloy [Fri, 25 Nov 2022 03:24:08 +0000 (11:24 +0800)]
correct model name display on running samples
Georgi Gerganov [Thu, 24 Nov 2022 21:13:26 +0000 (23:13 +0200)]
wasm : refactor wasm example + reuse fetch mechanism
Georgi Gerganov [Thu, 24 Nov 2022 18:15:07 +0000 (20:15 +0200)]
talk.wasm : update video link + some minor fixes
Georgi Gerganov [Thu, 24 Nov 2022 18:09:45 +0000 (20:09 +0200)]
Update README.md
Use a less cringy video to demo talk.wasm lol
Georgi Gerganov [Thu, 24 Nov 2022 18:06:51 +0000 (20:06 +0200)]
Update README.md
Georgi Gerganov [Thu, 24 Nov 2022 16:24:06 +0000 (18:24 +0200)]
talk.wasm : move to https://whisper.ggerganov.com/talk
This way, we can share the same models across different WASM examples
and not have to download them for each page
Georgi Gerganov [Thu, 24 Nov 2022 15:54:41 +0000 (17:54 +0200)]
models : add instructions for using HF fine-tuned models
Georgi Gerganov [Thu, 24 Nov 2022 15:54:16 +0000 (17:54 +0200)]
whisper : improve printfs
Georgi Gerganov [Thu, 24 Nov 2022 15:53:51 +0000 (17:53 +0200)]
main : fix dangling pointer when using stdin for input (#65)
Georgi Gerganov [Thu, 24 Nov 2022 15:52:04 +0000 (17:52 +0200)]
main, stream : remove --verbose flag (#178)
Georgi Gerganov [Wed, 23 Nov 2022 22:34:00 +0000 (00:34 +0200)]
talk.wasm : add audio pre-processing + bump memory
Georgi Gerganov [Wed, 23 Nov 2022 22:08:57 +0000 (00:08 +0200)]
talk.wasm : refactoring + update README.md
Georgi Gerganov [Wed, 23 Nov 2022 21:22:40 +0000 (23:22 +0200)]
models : add usage comments to the HF convert script (#157)
Georgi Gerganov [Wed, 23 Nov 2022 21:14:11 +0000 (23:14 +0200)]
models : fix HF fine-tuned model conversion script (#157)
It works now
Georgi Gerganov [Wed, 23 Nov 2022 20:40:06 +0000 (22:40 +0200)]
ggml : fix the fix
Georgi Gerganov [Wed, 23 Nov 2022 20:27:49 +0000 (22:27 +0200)]
ggml : fix cross-compile Linux -> Window with mingw (#168)
Georgi Gerganov [Wed, 23 Nov 2022 20:16:50 +0000 (22:16 +0200)]
Revert "update README.md"
This reverts commit
6a84147113669bed68bbc4d31e3c14f914092bf8 .
katsu560 [Wed, 23 Nov 2022 13:59:54 +0000 (22:59 +0900)]
update README.md
katsu560 [Wed, 23 Nov 2022 13:54:21 +0000 (22:54 +0900)]
ggml: change inline ggml_fp16_to_fp32, ggml_fp16_t ggml_fp32_to_fp16
katsu560 [Wed, 23 Nov 2022 12:31:05 +0000 (21:31 +0900)]
add gprof option
katsu560 [Wed, 23 Nov 2022 11:23:35 +0000 (20:23 +0900)]
fix AVX,AVX2,FMA,F16C detection on Linux and add flags for OpenBLAS
katsu560 [Wed, 23 Nov 2022 11:23:24 +0000 (20:23 +0900)]
add AVX support
Tamotsu Takahashi [Wed, 23 Nov 2022 06:17:13 +0000 (15:17 +0900)]
Build with OpenBLAS and SDL2 on windows
Georgi Gerganov [Wed, 23 Nov 2022 20:07:20 +0000 (22:07 +0200)]
models : minor changes to the HF convert script (#157)
Georgi Gerganov [Wed, 23 Nov 2022 15:17:31 +0000 (17:17 +0200)]
models : add "convert-h5-to-ggml.py" script (#157)
Converts transformers models to ggml.
Although the conversion is successful, it does not work for some reason.
Not sure why
Georgi Gerganov [Wed, 23 Nov 2022 15:17:01 +0000 (17:17 +0200)]
minor : updates few prints + fix buttons in whisper.wasm
Georgi Gerganov [Wed, 23 Nov 2022 07:53:55 +0000 (09:53 +0200)]
Update README.md
Georgi Gerganov [Wed, 23 Nov 2022 07:52:36 +0000 (09:52 +0200)]
Update README.md
Tamotsu Takahashi [Wed, 23 Nov 2022 00:46:56 +0000 (09:46 +0900)]
Find libopenblas.dll.a on windows
"lib" is needed for windows.
With this change, you can build whisper.cpp with OpenBLAS's prebuilt DLL.
1. extract a zip from https://github.com/xianyi/OpenBLAS/releases
2. copy the headers in (openblas)/include to the root directory of whisper.cpp
3. invoke cmake with -DCMAKE_LIBRARY_PATH=(openblas)\lib -DWHISPER_SUPPORT_OPENBLAS=ON
4. copy (openblas)/bin/libopenblas.dll to the same directory of whisper.dll after msbuild
https://github.com/ggerganov/whisper.cpp/issues/89#issuecomment-
1324391258
Georgi Gerganov [Wed, 23 Nov 2022 06:24:29 +0000 (08:24 +0200)]
unicode : fix character replacement (thanks to @tamo)