Enhanced Methods for Voice-Over Technique Refinement
Customising Dubbing and Translations with Kapwing's Brand Glossary
Kapwing's Studio offers a powerful tool called the Brand Glossary, which allows users to customise translations and pronunciations for brand words and phrases in subtitles, translation, and dubbing.
The Brand Glossary includes several useful features such as "Custom Spelling", "Translation Rules", and "Pronunciation". With "Custom Spelling", users can input commonly-misspelled words and their desired replacements. This ensures consistency in the content being dubbed or subtitled.
The "Translation Rules" feature allows for the selection of commonly-mistranslated words and their intended translations. This feature is particularly useful when dealing with industry-specific terminology or brand names that may have multiple meanings or are regional variations.
One of the most useful aspects of the Brand Glossary is the ability to save corrected pronunciation rules for future use. This is especially helpful when dealing with words or phrases that are difficult to pronounce or have multiple acceptable pronunciations. The Brand Glossary provides a "Generate suggestion" feature for pronunciation, making it easier to find the correct pronunciation for a given word.
When it comes to dubbing, a clear source video with high-quality audio is essential for producing high-quality dubbing. Minimal background audio in the source video can help the AI understand what needs to be dubbed more accurately. Dubbing quality can be improved by ensuring the source video's audio is as clear as possible.
Adjusting a translation to be shorter can help if a layer sounds too fast, and making it longer can help if a section sounds too slow. The speed of a translated voiceover can be adjusted by allowing adjustments to video speed within Advanced settings. However, it is important to note that the AI's ability to provide emotional inflection in voice cloning is currently limited.
Pronunciation issues in a dub can be fixed using the Pronunciation tab within the Brand Glossary. If a brand name or specific terminology needs to be kept in its original language, users can set it as "No-translate" within the Brand Glossary.
To adjust the speed of dubbing audio to match the original video's timing, the common approach is to split the dubbing audio track around the sections that need adjustment and then alter the audio speed on those segments using editing software. This allows the dubbed audio to fit the length of the video segment without changing the entire track speed.
In summary, the standard workflow is to segment your dubbed audio track and tweak the speed of those segments to fit the video timing, combined with possible translation text edits to optimise flow and naturalness. Software like Kapwing, pyVideoTrans, or professional audio/video editors provide these capabilities.
References: [1] Kapwing: https://kapwing.com/studio [2] pyVideoTrans: https://github.com/chrisjmorgan/pyVideoTrans [3] Professional Audio/Video Editors: https://www.techradar.com/best/video-editing-software [4] Dubbing Techniques: https://www.fandor.com/editorial/41480/the-art-of-dubbing-how-foreign-language-films-are-dubbed-for-american-tv [5] Animation Dubbing: https://www.animationworldnetwork.com/2018/03/29/dubbing-animation-with-accuracy-and-consistency/
Technology in data and cloud computing, such as artificial intelligence (AI), plays a significant role in Kapwing's Studio, particularly in its Brand Glossary tool. This feature leverages AI to customize translations, pronunciations, and even dubbing for brand-specific words and phrases, ensuring consistency and accuracy in the content being dubbed or subtitled.
The Brand Glossary's "Pronunciation" feature, for instance, generates suggestions for correct pronunciation, addressing any challenges in dubbing words or phrases that are difficult to pronounce or have multiple acceptable pronunciations.
