Name
Auxiliary Video Track in IMF
Date & Time
Wednesday, October 23, 2019, 4:30 PM - 5:00 PM
Location Name
San Francisco Room
Speakers
Description
Over 5% of the world’s population has disabling hearing loss. Content providers currently meet the needs of this audience by providing on screen translation in one of the 200 different international sign languages. In some territories, provision of such translated content is a regulatory requirement.
When this translated content is created, sign-language interpreters are commonly composited directly over a clone of the main video content, thereby generating a duplicate version of the programme. But as the industry focuses increasingly on supply chain optimisation, could there be a more efficient way of creating and distributing signed content in a global market?
This paper presents a solution to this business problem. It explores how IMF can be enhanced to enable compositing workflows.
The component-based nature of IMF was designed to bring versioning efficiency to the mastering and distribution process. However, as ST 2067 is currently limited to a single video track in any composition, visually translated content cannot benefit from the flexibility and efficiency available within IMF. Instead a separate full length video needs to be rendered with the sign language interpreter in vision.
To deal with this challenge, it is proposed that a synchronised auxiliary image track is created, which can be composited onto the main image track.
This work is currently being developed by the DPP in partnership with its member companies, with a view to submission to SMPTE as a plug-in for ST 2067.
The resulting feature will provide benefit to the implementer throughout the IMF lifecycle by enabling storage, editing, re-positioning and other processing of the interpreter video before compositing.
This paper also takes into consideration the challenge of different pixel-rasters between the main and the auxiliary video essence. The merits of the plug-in are demonstrated with a working prototype of a simple compositing process. Opportunities for complex and dynamic compositing via OPL and MetaRes are also discussed.
When this translated content is created, sign-language interpreters are commonly composited directly over a clone of the main video content, thereby generating a duplicate version of the programme. But as the industry focuses increasingly on supply chain optimisation, could there be a more efficient way of creating and distributing signed content in a global market?
This paper presents a solution to this business problem. It explores how IMF can be enhanced to enable compositing workflows.
The component-based nature of IMF was designed to bring versioning efficiency to the mastering and distribution process. However, as ST 2067 is currently limited to a single video track in any composition, visually translated content cannot benefit from the flexibility and efficiency available within IMF. Instead a separate full length video needs to be rendered with the sign language interpreter in vision.
To deal with this challenge, it is proposed that a synchronised auxiliary image track is created, which can be composited onto the main image track.
This work is currently being developed by the DPP in partnership with its member companies, with a view to submission to SMPTE as a plug-in for ST 2067.
The resulting feature will provide benefit to the implementer throughout the IMF lifecycle by enabling storage, editing, re-positioning and other processing of the interpreter video before compositing.
This paper also takes into consideration the challenge of different pixel-rasters between the main and the auxiliary video essence. The merits of the plug-in are demonstrated with a working prototype of a simple compositing process. Opportunities for complex and dynamic compositing via OPL and MetaRes are also discussed.
Technical Depth of Presentation
Whilst the intention is to include advanced technical detail in the prototype demonstration, the narrative will be accessible to anyone with a fundamental understanding of IMF
What Attendees will Benefit Most from this Presentation
This proposal covers the entire supply-chain and is relevant to Engineers as well as Managers. C-Level Executives may find it useful to learn about continuous expansion of features.
Take-Aways from this Presentation
Attendees will be introduced to a significant expansion of IMF capabilities which the authors expect to be stimulating for the community.
Those who are new to the subject of signed interpretation in video distribution will gain an understanding of the existing workflows and the challenges that distributors face.
Potential adopters will discover another efficiency that they could realise by implementing IMF.New perspectives on IMF may inspire attendees to create further plug-ins to address similar issues.