Demo app to demonstrate whisper running on iOS with CoreML encoder and GGML/Metal based decoder. The decoder uses Metal kernels to allow KV cache optimizations.
- Open the project in Xcode
- Run the demo on an iOS device
- Use the record button to record audio and transcribe it
Transcription speeds dramatically improve after 2-3 warmup runs.