I want to allow a user to enable audio description for a video
elynema opened this issue · 4 comments
Description
In order to provide a more inclusive experience for visually impaired or blind users, a video canvas may be supplemented by an audio track that describes important visual information, such as physical actions, facial expressions, costumes, settings, scene changes, or on-screen text. The IIIF viewer must be able to identify a track with audio description and allow the user to enable playback of this secondary audio track in lieu of a primary audio track that contains only the original audio.
Currently, audio description is generally enabled at the device level - on a TV or cable box, on a phone or tablet.
Variation(s)
The PBS example player sited below suggests that a similar solution might be relevant for when there are options for a video that is dubbed in one more languages that are not the original language of the video (which is a separate use case from translated subtitles).
Proposed Solutions
(any ideas about how your use case might be supported)
Additional Background
Example instructions for how to turn on audio descriptions to be used with the PBS/PBS Kids sites and apps: https://help.pbs.org/support/solutions/articles/12000084565-how-do-i-enable-audio-description-on-pbs-videos-
For websites, this is generally a configuration that is turned on in the video player: https://help.pbs.org/support/solutions/articles/12000084565-how-do-i-enable-audio-description-on-pbs-videos-#PBSKIDS.org-Website
This screenshot shows how audio description is enabled on the PBS video player. Note that this is a separate option from caption configuration (which is intended to support users who are hard of hearing).
You can listen to the audio description for this video here: https://www.pbs.org/video/how-to-have-an-american-baby-1qqspq/
Background on captions, transcripts, and audio description: https://www.tpgi.com/captions-and-transcripts-and-audio-descriptions-oh-my/
Audio description can be provided in a variety of format:
- integrated into audio as a secondary track
- separate text that can be read via speech to text
https://www.w3.org/WAI/media/av/description/
https://www.3playmedia.com/blog/add-audio-description-videos/
Audio description can be provided as an alternate track within the video container. Can that be handled by the underlying player without being referenced in IIIF? Is this something we could test with existing IIIF viewers? Not all media players support secondary audio track selection.
Perhaps may just need to provide a recommendation for how to provide these in the video container itself?
Smithsonian is not using IIIF for AV, but are interested and do have audio description for a lot of their content. Example: https://mads.si.edu/mads/view/NMAH-AC0018-OF0005