openai / whisper

The following command will transcribe speech in audio files, using the turbo model:

whisper audio.flac audio.mp3 audio.wav --model turbo

The default setting (which selects the turbo model) works well for transcribing English. However, the turbo model is not trained for translation tasks. If you need to translate non-English speech into English, use one of the multilingual models (tiny, base, small, medium, large) instead of turbo.

For example, to transcribe an audio file containing non-English speech, you can specify the language:

whisper japanese.wav --language Japanese

To translate speech into English, use:

whisper japanese.wav --model medium --language Japanese --task translate

Note: The turbo model will return the original language even if --task translate is specified. Use medium or large for the best translation results.

Run the following to view all available options:

whisper --help

See tokenizer.py for the list of all available languages.