UdonTTS【VRChatワールド用音声合成システム】
- ¥ 0
UdonTTS is text-to-speech system based on VITS and ShaderGPT. It is designed for Unity 2022 and compatible with VRChat Udon. Currently it only supports English and Japanese. UdonTTSはVITSとShaderGPTをベースにした音声合成システムです。Unity2022用に設計されており、VRChat Udonと互換性があります。現在は英語と日本語にのみ対応しています。
Demo | デモ
English TTS https://vrchat.com/home/launch?worldId=wrld_80adc04c-d7f0-4d13-87d1-8e6a135ce1d2 Japanese TTS https://vrchat.com/home/launch?worldId=wrld_0a0dc744-b406-41d9-8285-05800ea175ab
License | 利用規約
UdonTTS and ShaderGPT are released under MIT license. ShaderGPT is also available at: https://gitlab.com/lox9973/ShaderGPT
License | 利用規約 (English TTS)
"Massively Multilingual Speech (MMS): English Text-to-Speech" by Facebook, is licensed under CC-BY-NC 4.0. https://huggingface.co/facebook/mms-tts-eng
License | 利用規約 (Japanese TTS)
The VITS model is trained with phi16's "Pipeline˸ Commentary" speech data, and it is licensed under CC-BY-NC 4.0. https://vrchat.com/home/launch?worldId=wrld_92f5cee0-8416-40ea-961f-3ee68ea691cf Udon scripts contain compiled code from the following projects: Open JTalk by Nagoya Institute of Technology is released under the Modified BSD license. https://open-jtalk.sourceforge.net Flite by Carnegie Mellon University is released under a BSD-like license. https://github.com/festvox/flite
Credit | クレジット
"VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech" by Jaehyeon Kim, Jungil Kong, Juhee Son https://github.com/jaywalnut310/vits The Japanese TTS model is trained using "VITS Fast Fine-tuning" by Plachtaa: https://github.com/Plachtaa/VITS-fast-fine-tuning WASMs are converted to Udon using wasm2usharp by raii: https://github.com/raii-x/wasm2usharp
Changelog | 変更履歴
2024-10-24: clarify license 2024-10-23: v2.0 add japanese 2024-06-08: v1.0 initial release