IntroducciĂłn
Whisper es un sistema de reconocimiento automático de voz (automatic speech recognition (ASR)) entrenado en 680.000 horas de datos supervisados ​​multilingües y multitarea recopilados de la web. El uso de un conjunto de datos tan grande y diverso conduce a una mayor solidez ante los acentos, el ruido de fondo y el lenguaje técnico. Además, permite la transcripción en varios idiomas, asà como la traducción de esos idiomas al inglés
InstalaciĂłn
Para poder instalar esta herramienta lo mejor es crearse un nuevo entorno de Anaconda
!conda create -n whisperCopied
Entramos al entorno
!conda activate whisperCopied
Instalamos todos los paquetes necesarios
!conda install pytorch torchvision torchaudio pytorch-cuda=11.6 -c pytorch -c nvidiaCopied
Por Ăşltimo instalamos whisper
!pip install git+https://github.com/openai/whisper.gitCopied
Y actualizamos ffmpeg
!sudo apt update && sudo apt install ffmpegCopied
Uso
Importamos whisper
import whisperCopied
Seleccionamos el modelo, cuanto más grande mejor lo hará
# model = "tiny"# model = "base"# model = "small"# model = "medium"model = "large"model = whisper.load_model(model)Copied
Cargamos el audio de este anuncio antiguo (de 1987) de Micro Machines
audio_path = "MicroMachines.mp3"audio = whisper.load_audio(audio_path)audio = whisper.pad_or_trim(audio)Copied
mel = whisper.log_mel_spectrogram(audio).to(model.device)Copied
_, probs = model.detect_language(mel)print(f"Detected language: {max(probs, key=probs.get)}")Copied
Detected language: en
options = whisper.DecodingOptions()result = whisper.decode(model, mel, options)Copied
result.textCopied
"This is the Micro Machine Man presenting the most midget miniature motorcade of micro machines. Each one has dramatic details, terrific trim, precision paint jobs, plus incredible micro machine pocket play sets. There's a police station, fire station, restaurant, service station, and more. Perfect pocket portables to take any place. And there are many miniature play sets to play with and each one comes with its own special edition micro machine vehicle and fun fantastic features that miraculously move. Raise the boat lift at the airport, marina, man the gun turret at the army base, clean your car at the car wash, raise the toll bridge. And these play sets fit together to form a micro machine world. Micro machine pocket play sets so tremendously tiny, so perfectly precise, so dazzlingly detailed, you'll want to pocket them all. Micro machines and micro machine pocket play sets sold separately from Galoob. The smaller they are, the better they are."
