fixie-ai/common_voice_17_0
Viewer • Updated • 11.4M • 204k • 18
How to use mmarron14/whisper-medium-cv17-es-5-steps_proc1 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="mmarron14/whisper-medium-cv17-es-5-steps_proc1") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("mmarron14/whisper-medium-cv17-es-5-steps_proc1")
model = AutoModelForSpeechSeq2Seq.from_pretrained("mmarron14/whisper-medium-cv17-es-5-steps_proc1", device_map="auto")This model is a fine-tuned version of openai/whisper-medium on the Common Voice 17.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer Ortho | Wer |
|---|---|---|---|---|---|
| No log | 0.2 | 1 | 3.3895 | 994.8653 | 63402.4096 |
| No log | 0.4 | 2 | 1.5156 | 976.2316 | 62252.6104 |
| No log | 0.6 | 3 | 0.6959 | 811.1335 | 51731.7269 |
| No log | 0.8 | 4 | 0.2952 | 39.6266 | 2471.8876 |
| No log | 1.0 | 5 | 0.1937 | 6.8883 | 375.5020 |
Base model
openai/whisper-medium