whisper.cpp
Alex Ziskind about whisper.cpp (opens in a new tab)
whisper.cpp (opens in a new tab) github
Port of OpenAI's Whisper model in C/C++
High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model:
- Plain C/C++ implementation without dependencies
- Apple Silicon first-class citizen - optimized via
- ARM NEON, Accelerate framework, Metal and Core ML
- AVX intrinsics support for x86 architectures
- VSX intrinsics support for POWER architectures
- Mixed F16 / F32 precision
- 4-bit and 5-bit integer quantization support
- Zero memory allocations at runtime
- Vulkan support
- Support for CPU-only inference
- Efficient GPU support for NVIDIA
- OpenVINO Support
- Ascend NPU Support
- C-style API
AI audio transcription
- Install WhisperFile on Windows on CPU - Easy AI Transcription of Any Audio (opens in a new tab)
- Whisperfile - Transcribe Any Audio File with AI Locally for Free - Easy Tutorial (opens in a new tab)
- Install and Run Local AI Model Whisperfile for Converting Speech or Audio to Text for Free (opens in a new tab)
- simonwillison whisperfile (opens in a new tab)