Abstract
This chapter focuses on the time system used by the decoder at the end user side to replicate the encoder’s clock system to accomplish a synchronized media play-out at end user side. The time system usually uses tools such as clock references and timestamps coded within the media stream. This chapter does not go into detail of the protocols used in IP networks to perform the media delivery, but it explains in detail the time-related fields coded within the media streams which are used at the user side decoder to provide a synchronized media play-out. The principal Moving Picture Experts Group (MPEG) media standards and their time system are described in this chapter. That includes MPEG-2 Transport Streams (MP2T), MPEG-4, MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH), and MPEG Media Transport (MMT). This chapter also details the time information used by Digital Video Broadcasting (DVB) which is broadly used in multiple media delivery systems and used hand in hand with MPEG standards. First of all, this chapter describes the synchronization between video–audio media streams (lip sync) within a program in MP2T, and secondly, the synchronization between multiple programs, delivered within a multiplexed single MP2T stream. Secondly, this chapter describes timing issues in MPEG-4, which utilizes a different timeline system from MP2T to implement clock references and timestamps, as it is an object-oriented multimedia standard. Thirdly, this chapter describes timing issues in MPEG-DASH, which is an Adaptive Streaming over HTTP protocol widely used over the Internet. Additionally, this chapter also describes the time transmission in DVB systems, which use MP2T as a media container. The tools used are the DVB Service Information (DVB SI) and MPEG-2 Program-Specific Information (MPEG-2 PSI) tables. Finally, this chapter introduces the latest MPEG standard for media delivery, MMT, which aims to be a unique media delivery standard for heterogeneous networks, broadband technologies used in Internet TV and IPTV (Internet TV refers in this chapter to media delivery over a public non-managed IP network, such as Internet, and IPTV refers to media delivery over a private, managed IP network media delivery). It has also been proposed for broadcast (DVB) media delivery.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The presence of the Video Presentation Buffer may be not needed, as happens in [2], as the Frame Reorder Buffer could take its role, although the presence of the Video Presentation Buffer shows the concept of the presentation timestamp more clearly.
- 2.
‘Private data is any user data which is not coded according to a standard specified by ITU-T|ISO/IEC and referred to in this Specification’ [1].
- 3.
For segmentBase, the MultipleSegmentBaseInformation is used, which ‘specifies multiple Segment base information’ [8].
- 4.
ISAP is the index of the Stream Access Point (SAP). SAP is the ‘position in a Representation enabling playback of a media stream to be started using only the information contained in Representation data starting from that position onward’.
- 5.
‘ISAU is the index of the first access unit that follows ISAP’ [8]. Stream Access Unit (SAU).
- 6.
‘This includes spatial and temporal location of media objects in a given scene’ [17].
References
Information Technology. Generic Coding of Moving Pictures and Associated Audio: Systems Recommendation H.222 (2000E), ISO/IEC 13818-1, Dec 2010
Chen, X.: Transporting Compressed Digital Video, 1st edn. Kluwer Academic Publishers (2002)
Information Technology Generic Coding of Moving Pictures and Associated Audio Information. Amendment 1: Delivery of timeline for external data. Recommendation ITU-T H.222 (2014) Amendment 1, Apr 2015
The Moving Picture Experts Group. http://mpeg.chiariglione.org. Accessed 26 Mar 2017
Herpel, C.: Elementary stream management in MPEG-4. IEEE Trans. Circuits Syst. Video Technol. 9(2), 315–324 (1999)
Beloqui, L., Boronat, F., Montagut, M., Melvin, H.: Understanding timelines within MPEG standards. IEEE Commun. Surv. Tutorials (2016)
Information Technology. Generic Coding of Audio-Visual Objects. Part 1: Systems (2010E), ISO/IEC 14496-1, June 2010
Information Technology. Dynamic Adaptive Streaming over HTTP (DASH). Part 1: Media Presentation Description and Segment Formats. ISO/IEC 23009-1:2012, Apr 2012
ETSI EN 300 468 v1.14.1 (2014-01). Specification for Service Information (SI) in DVB Systems. Digital Video Broadcasting (DVB), Jan 2014
ETSI TR 101 211 v1.11.2. Guidelines on Implementation and Usage of Service Information (SI). Technical Report. European Telecommunications. Digital Video Broadcasting (DVB), May 2012
Julian Date Calendar/Calculator Day-of-Year (JDay): National Aeronautics and Space Administration, 05 May 2016. https://www-air.larc.nasa.gov/tools/jday.htm. Accessed 19 Mar 2017
Information Technology. High Efficiency Coding and Media Delivery in Heterogeneous Environments. Part 1: MPEG Media Transport (MMT), ISO/IEC 23008-1:2014, June 2014
Kwang-deok, S., Tae-jun, J., Jeonglu, Y., Ki, K.C., **woo, H.: A new timing model design for MPEG media transport (MMT). In: Proceedings of IEEE International Symposium on BMSB, pp. 1–5, June 2012
Aoki, S., Otsuki, K., Hamada, H.: Effective usage of MMT in broadcasting systems. In: Proceedings of IEEE International Symposium on BMSB, pp. 1–6, June 2013
Lim, Y.: MMT, new alternative to MPEG-2 TS and RTP. In: Proceedings of IEEE International Symposium on BMSB, pp. 1–5, June 2013
Youngkwon, L., Kyungmo, P., ** Young, L., Aoki, S., Fernando, G.: MMT: an emerging MPEG standard for multimedia delivery over the internet. IEEE MultiMedia 20(1), 80–85 (2013)
Fernando, G.: MMT: the next-generation media transport standard. STE Commun. 10(2), 45–48 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Definitions
- MPEG Timeline
-
Time information, clock references and timestamps, to reproduce, time-align encoder/source media clock to the decoder/receiver media clock.
- Timestamps
-
A timestamp is used to agree on a specific moment in time, such as decoding, composing or playing time of an Access Unit (AU) or Media Access Unit (MDU).
- Clock References
-
They are the mechanism to recreate encoder’s clock frequency at the decoder to guarantee the correct media stream play-out, the means used by MPEG standards to reproduce encoder’s clock rate at the decoder.
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Yuste, L.B. (2018). Time and Timing Within MPEG Standards. In: Montagud, M., Cesar, P., Boronat, F., Jansen, J. (eds) MediaSync. Springer, Cham. https://doi.org/10.1007/978-3-319-65840-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-65840-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-65839-1
Online ISBN: 978-3-319-65840-7
eBook Packages: Computer ScienceComputer Science (R0)