rwkv.cpp/ggml/examples/whisper
ed barz 099392db01 ??? 2023-06-12 08:00:48 +02:00
..
CMakeLists.txt ??? 2023-06-12 08:00:48 +02:00
README.md ??? 2023-06-12 08:00:48 +02:00
convert-pt-to-ggml.py ??? 2023-06-12 08:00:48 +02:00
main.cpp ??? 2023-06-12 08:00:48 +02:00
quantize.cpp ??? 2023-06-12 08:00:48 +02:00
whisper.cpp ??? 2023-06-12 08:00:48 +02:00
whisper.h ??? 2023-06-12 08:00:48 +02:00

README.md

whisper

Port of OpenAI's Whisper ASR model in C/C++ using ggml

More info

Checkout https://github.com/ggerganov/whisper.cpp

Memory usage

Model Disk Mem
tiny 75 MB ~280 MB
base 142 MB ~430 MB
small 466 MB ~1.0 GB
medium 1.5 GB ~2.6 GB
large 2.9 GB ~4.7 GB

ggml format

The original models are converted to a custom binary format. This allows to pack everything needed into a single file:

  • model parameters
  • mel filters
  • vocabulary
  • weights

For more details, see the conversion script convert-pt-to-ggml.py