{"id":8443,"date":"2024-11-12T17:53:14","date_gmt":"2024-11-12T16:53:14","guid":{"rendered":"https:\/\/projecteaina.cat\/tech\/?post_type=publicacions&#038;p=8443"},"modified":"2024-11-21T18:54:21","modified_gmt":"2024-11-21T17:54:21","slug":"enhancing-crowdsourced-audio-for-text-to-speech-models","status":"publish","type":"publicacions","link":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/","title":{"rendered":"Enhancing Crowdsourced Audio for Text-to-Speech Models"},"excerpt":{"rendered":"<p>High-quality audio data is a critical prerequisite for training robust text-to-speech models, which often limits the use of opportunistic or crowdsourced datasets. This paper presents an approach to overcome this limitation by implementing a denoising pipeline on the Catalan subset of Commonvoice, a crowdsourced corpus known for its inherent noise and variability. The pipeline incorporates an audio enhancement phase followed by a selective filtering strategy. We developed an automatic filtering mechanism leveraging Non-Intrusive Speech Quality Assessment (NISQA) models to identify and retain the highest quality samples post-enhancement. To evaluate the efficacy of this approach, we trained a state of the art diffusion-based TTS model on the processed dataset. The results show a significant improvement, with an increase of 0.4 in the UTMOS Score compared to the baseline dataset without enhancement. This methodology shows promise for expanding the utility of crowdsourced data in TTS applications, particularly for mid to low resource languages like Catalan.<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"class_list":["post-8443","publicacions","type-publicacions","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/\" \/>\n<meta property=\"og:locale\" content=\"ca_ES\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech\" \/>\n<meta property=\"og:description\" content=\"High-quality audio data is a critical prerequisite for training robust text-to-speech models, which often limits the use of opportunistic or crowdsourced datasets. This paper presents an approach to overcome this limitation by implementing a denoising pipeline on the Catalan subset of Commonvoice, a crowdsourced corpus known for its inherent noise and variability. The pipeline incorporates an audio enhancement phase followed by a selective filtering strategy. We developed an automatic filtering mechanism leveraging Non-Intrusive Speech Quality Assessment (NISQA) models to identify and retain the highest quality samples post-enhancement. To evaluate the efficacy of this approach, we trained a state of the art diffusion-based TTS model on the processed dataset. The results show a significant improvement, with an increase of 0.4 in the UTMOS Score compared to the baseline dataset without enhancement. This methodology shows promise for expanding the utility of crowdsourced data in TTS applications, particularly for mid to low resource languages like Catalan.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/\" \/>\n<meta property=\"og:site_name\" content=\"Projecte Aina Tech\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-21T17:54:21+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@projecte_aina\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/publicacions\\\/enhancing-crowdsourced-audio-for-text-to-speech-models\\\/\",\"url\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/publicacions\\\/enhancing-crowdsourced-audio-for-text-to-speech-models\\\/\",\"name\":\"Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#website\"},\"datePublished\":\"2024-11-12T16:53:14+00:00\",\"dateModified\":\"2024-11-21T17:54:21+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/publicacions\\\/enhancing-crowdsourced-audio-for-text-to-speech-models\\\/#breadcrumb\"},\"inLanguage\":\"ca\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/publicacions\\\/enhancing-crowdsourced-audio-for-text-to-speech-models\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/publicacions\\\/enhancing-crowdsourced-audio-for-text-to-speech-models\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Inici\",\"item\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Enhancing Crowdsourced Audio for Text-to-Speech Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#website\",\"url\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/\",\"name\":\"Projecte Aina Tech\",\"description\":\"Impulsant l&#039;\u00fas del catal\u00e0 en l&#039;era digital\",\"publisher\":{\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ca\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#organization\",\"name\":\"Projecte Aina Tech\",\"url\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ca\",\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/wp-content\\\/uploads\\\/2023\\\/11\\\/cropped-aina-home-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/wp-content\\\/uploads\\\/2023\\\/11\\\/cropped-aina-home-logo.jpg\",\"width\":512,\"height\":512,\"caption\":\"Projecte Aina Tech\"},\"image\":{\"@id\":\"https:\\\/\\\/projecteaina.cat\\\/tech\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/projecte_aina\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/projecte-aina\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/","og_locale":"ca_ES","og_type":"article","og_title":"Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech","og_description":"High-quality audio data is a critical prerequisite for training robust text-to-speech models, which often limits the use of opportunistic or crowdsourced datasets. This paper presents an approach to overcome this limitation by implementing a denoising pipeline on the Catalan subset of Commonvoice, a crowdsourced corpus known for its inherent noise and variability. The pipeline incorporates an audio enhancement phase followed by a selective filtering strategy. We developed an automatic filtering mechanism leveraging Non-Intrusive Speech Quality Assessment (NISQA) models to identify and retain the highest quality samples post-enhancement. To evaluate the efficacy of this approach, we trained a state of the art diffusion-based TTS model on the processed dataset. The results show a significant improvement, with an increase of 0.4 in the UTMOS Score compared to the baseline dataset without enhancement. This methodology shows promise for expanding the utility of crowdsourced data in TTS applications, particularly for mid to low resource languages like Catalan.","og_url":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/","og_site_name":"Projecte Aina Tech","article_modified_time":"2024-11-21T17:54:21+00:00","twitter_card":"summary_large_image","twitter_site":"@projecte_aina","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/","url":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/","name":"Enhancing Crowdsourced Audio for Text-to-Speech Models - Projecte Aina Tech","isPartOf":{"@id":"https:\/\/projecteaina.cat\/tech\/#website"},"datePublished":"2024-11-12T16:53:14+00:00","dateModified":"2024-11-21T17:54:21+00:00","breadcrumb":{"@id":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/#breadcrumb"},"inLanguage":"ca","potentialAction":[{"@type":"ReadAction","target":["https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/projecteaina.cat\/tech\/publicacions\/enhancing-crowdsourced-audio-for-text-to-speech-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Inici","item":"https:\/\/projecteaina.cat\/tech\/"},{"@type":"ListItem","position":2,"name":"Enhancing Crowdsourced Audio for Text-to-Speech Models"}]},{"@type":"WebSite","@id":"https:\/\/projecteaina.cat\/tech\/#website","url":"https:\/\/projecteaina.cat\/tech\/","name":"Projecte Aina Tech","description":"Impulsant l&#039;\u00fas del catal\u00e0 en l&#039;era digital","publisher":{"@id":"https:\/\/projecteaina.cat\/tech\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/projecteaina.cat\/tech\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ca"},{"@type":"Organization","@id":"https:\/\/projecteaina.cat\/tech\/#organization","name":"Projecte Aina Tech","url":"https:\/\/projecteaina.cat\/tech\/","logo":{"@type":"ImageObject","inLanguage":"ca","@id":"https:\/\/projecteaina.cat\/tech\/#\/schema\/logo\/image\/","url":"https:\/\/projecteaina.cat\/tech\/wp-content\/uploads\/2023\/11\/cropped-aina-home-logo.jpg","contentUrl":"https:\/\/projecteaina.cat\/tech\/wp-content\/uploads\/2023\/11\/cropped-aina-home-logo.jpg","width":512,"height":512,"caption":"Projecte Aina Tech"},"image":{"@id":"https:\/\/projecteaina.cat\/tech\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/projecte_aina","https:\/\/www.linkedin.com\/company\/projecte-aina\/"]}]}},"_links":{"self":[{"href":"https:\/\/projecteaina.cat\/tech\/wp-json\/wp\/v2\/publicacions\/8443","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projecteaina.cat\/tech\/wp-json\/wp\/v2\/publicacions"}],"about":[{"href":"https:\/\/projecteaina.cat\/tech\/wp-json\/wp\/v2\/types\/publicacions"}],"wp:attachment":[{"href":"https:\/\/projecteaina.cat\/tech\/wp-json\/wp\/v2\/media?parent=8443"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}