TelVue Connect has an optional feature that leverages IBM Watson’s speech-to-text algorithms to automatically generate timed Closed Caption files for videos: WebVTT for CloudCast VOD and OTT streaming, and 608/708 for broadcast.
To generate the closed captions:
- From the Media Tab, select Generate Captions from the actions menu for a given media record. This is also available from the actions menu in the Media Edit page.
- A Captions Generation Options menu will be presented that allows optionally selecting the source language or from Custom Language Models to improve caption accuracy, and whether to use Smart Formatting and Profanity Filtering. Additionally you can select one or more Caption Substitutions to automatically find and replace certain text. Source languages and dialects supported include: English (US), English (UK), Arabic, Portuguese (Brazilian), Chinese (Mandarin), Dutch, French, German, Italian, Japanese, Korean, Spanish (Argentinian, Castilian, Chilean, Colombian, Mexican, Peruvian).
- Closed Captions generation can also be a Bulk Action:
- In the Media Library, check off the videos to be captioned
- Select the Bulk Generate Closed Captions action
- Closed Captions can also be generated directly from the Assets Tab in the Media Edit page.
- Click on the Assets Tab and Scroll down to the Closed Caption section at the bottom of the Assets Tab.
- Click the Icon under Actions to begin the process of generating (or regenerating) a closed caption file.Under the Activity tab, you can follow the progress of the caption file creation:
- Extracting the audio
- Speech-to-Text transcription of the audio
- Conversion of the resulting timed text file to the WebVTT format commonly used in VOD streaming.
- The overall process is a little faster than real time
- When completed, the video thumbnail displays a CC icon. Hovering over the icon will show the types of captioning available, such as WebVTT for VOD files and 608 Embedded for Broadcast files.
- Once completed, the Closed Caption file will automatically be attached to any video included in a CloudCast player or OTT app. Additionally, any subsequent Broadcast transcodes will embed the generated captions as 608/708 embedded as long as the “Embed captions in broadcast transcodes” option is enabled. This setting can be managed by an Admin from Administration –> Organization Settings –> Captions. Note that for embedding captions in Broadcast files, the Broadcast transcode must be manually triggered after the caption generation has completed.
- To view the captions, the viewer needs to start the video, and then select the CC option in the CloudCast player.
- The captions are also viewable in the Preview within Connect. Click the CC icon in the preview player control bar to toggle captions on or off.
- The Closed Caption file is available for download from the Assets Tab by clicking the icon under Actions.
- The Closed Caption file can be deleted from the Assets Tab by clicking the icon under Actions.
- To have captions generated automatically for all uploaded media, enable the configuration option “Auto generation captions for all uploaded files”. This setting can be managed by an Admin from Administration –> Organization Settings –> Captions.
Edit the Captions
The accuracy of any closed caption file depends on the clarity of the speech in the video. If necessary, a closed caption file can be improved with manual editing and re-timing.
One versatile and free open-source caption editing tool is CADET, developed by the National Center for Accessible Media at WGBH. Download the CADET app to your computer and then open in a browser. To edit a caption file:
- First, download a preview version of the video from the Assets Tab in TelVue Connect.
- Download the captions file from the Assets Tab in TelVue Connect.
- Upload the preview video and import the captions file to CADET, and these will be displayed side by side.
- You can then edit the text in the individual caption cells.
- You can also re-time the in and out points using some simple keyboard shortcuts, as the preview video plays. Refer to the CADET documentation for details.
- Re-export the revised caption file.
- Re-upload in the Media Edit page in TelVue Connect via the Closed Captioning File – Choose File button. The revised captions will replace the previous file, and will now play out in CloudCast and be available for Broadcast transcodes.
Translate the Captions to Additional Languages
Users can translate the primary captions to over 100 additional languages using the optional TelVue Connect Caption Translation service.
Users can track the usage of their captioning hours at Administration → Reports → Caption Generation Usage Reports.
The TelVue Closed Captioning service can be purchased in blocks of 100, 500, and 1,000 hours. Please contact firstname.lastname@example.org for pricing.