DEV
Mayank Kumar@mayank681
is under improvement
6
Events attended
1
Submissions made
Senior Data Scientist
Canada
6 years of experience
About me
I have good experience with Pytorch, transformer, gnns, .. 6 year of AI service based experience. Great with problem formulation and design and quick POC
I built with
ElevenLabsis under improvement
🤓 Submissions
Magic Dub - 11Labs
MagicDub aims to allow the user to watch their fav foreign show in high-quality English audio. We strongly believe that with the advancement in Generative AI, we are at the right stage to crack a make one and serve all model. Beautiful movies are left out of reach due to language barriers. Subtitles are the most common and easy way to watch out acclaimed foreign movies. With the help of TTS, we aim to recreate the full foreign movie experience in the English Language/ chosen language. For the same, we have relied on subtitles and used diarization technique to identify rough speaker change and corresponding audio segments. From the collected audio segment, we clone new audio for the character and then use respective voices to generate English dialogues using subtitles. The solution also intended to use sentiment, duration and other stats of each subtitle scene and use the same for generating TTS.
