AI voice cloning

StreamVC is a real-time low-latency speech conversion solution developed by Google that can match the timbre of the target speech while maintaining the content and rhythm of the source speech. The technology is particularly suitable for real-time communication scenarios such as phone calls and video conferencing, and can be used for use cases such as voice anonymization. StreamVC utilizes the architecture and training strategy of the SoundStream neural audio codec to achieve lightweight and high-quality speech synthesis. It also demonstrates the effectiveness of learning soft speech units and providing whitened fundamental frequency information to improve pitch stability without leaking source timbre information.

OpenVoice is an open source voice cloning technology that can accurately clone reference timbres and generate voices in multiple languages ​​and accents. It can flexibly control speech style parameters such as emotion and accent, as well as rhythm, pauses and intonation, etc. It implements zero-shot cross-language speech cloning, that is, neither the language of the generated speech nor the reference speech needs to appear in the training data.