{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Speaker Vector HuggingFace"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"\n",
"This tutorial is available as an IPython notebook at [malaya-speech/example/speaker-vector-huggingface](https://github.com/huseinzol05/malaya-speech/tree/master/example/speaker-vector-huggingface).\n",
" \n",
"
"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"\n",
"This module is language independent, so it save to use on different languages. Pretrained models trained on multilanguages.\n",
" \n",
"
"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"\n",
"\n",
"This is an application of malaya-speech Pipeline, read more about malaya-speech Pipeline at [malaya-speech/example/pipeline](https://github.com/huseinzol05/malaya-speech/tree/master/example/pipeline).\n",
" \n",
"
"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [],
"source": [
"import os\n",
"\n",
"os.environ['CUDA_VISIBLE_DEVICES'] = ''"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"`pyaudio` is not available, `malaya_speech.streaming.pyaudio_vad.stream` is not able to use.\n"
]
}
],
"source": [
"from malaya_speech import Pipeline\n",
"import malaya_speech\n",
"import numpy as np"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [],
"source": [
"import logging\n",
"\n",
"logging.basicConfig(level=logging.INFO)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### List available HuggingFace model"
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"INFO:malaya_speech.speaker_vector:tested on VoxCeleb2 test set. Lower EER is better.\n",
"INFO:malaya_speech.speaker_vector:download the test set at https://github.com/huseinzol05/malaya-speech/tree/master/data/voxceleb\n"
]
},
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" Size (MB) | \n",
" Embedding Size | \n",
" EER | \n",
"
\n",
" \n",
" \n",
" \n",
" | microsoft/wavlm-base-sv | \n",
" 405.0 | \n",
" 512.0 | \n",
" 0.078274 | \n",
"
\n",
" \n",
" | microsoft/wavlm-base-plus-sv | \n",
" 405.0 | \n",
" 512.0 | \n",
" 0.066884 | \n",
"
\n",
" \n",
" | microsoft/unispeech-sat-large-sv | \n",
" 1290.0 | \n",
" 512.0 | \n",
" 0.203277 | \n",
"
\n",
" \n",
" | microsoft/unispeech-sat-base-sv | \n",
" 404.0 | \n",
" 512.0 | \n",
" 0.078282 | \n",
"
\n",
" \n",
" | microsoft/unispeech-sat-base-plus-sv | \n",
" 404.0 | \n",
" 512.0 | \n",
" 0.076128 | \n",
"
\n",
" \n",
"
\n",
"