Group of pictures
In video coding, a group of pictures, or GOP structure, specifies the order in which intra- and inter-frames are arranged. The GOP is a collection of successive pictures within a coded video stream. Each coded video stream consists of successive GOPs, from which the visible frames are generated. Encountering a new GOP in a compressed video stream means that the decoder doesn't need any previous frames in order to decode the next ones, and allows fast seeking through the video.
Elements
A GOP can contain the following picture types:
- I frame (intra coded picture, also called keyframe[1]) – a picture that is coded independently of all other pictures. Each GOP begins (in decoding order) with this type of frame.
- P frame (predictive coded picture) – contains motion-compensated difference information relative to previously decoded pictures. In older designs such as MPEG-1, H.262/MPEG-2 and H.263, each P frame can only reference one picture, and that picture must precede the P frame in display order as well as in decoding order and must be an I or P frame. These constraints do not apply in the newer standards H.264/MPEG-4 AVC and HEVC.
- B frame (bipredictive coded picture) – contains motion-compensated difference information relative to previously decoded pictures. In older designs such as MPEG-1 and H.262/MPEG-2, each B frame can only reference two frames, the one which precedes the B frame in display order and the one which follows, and all referenced pictures must be I or P frames. These constraints do not apply in newer standards H.264/MPEG-4 AVC and HEVC.
- D frame (DC direct coded picture) – serves as a fast-access representation of a frame for loss robustness or fast-forward. D frames are only used in MPEG-1 video.
An I frame indicates the beginning of a GOP. Afterwards several P and B frames follow. In older designs, the allowed ordering and referencing structure is relatively constrained.[2]
The I frames contain the full image and do not require any additional information to reconstruct them. Typically, encoders use GOP structures that cause each I frame to be a "clean random access point," such that decoding can start cleanly on an I frame and any errors within the GOP structure are corrected after processing a correct I frame.
In the newer designs found in H.264/MPEG-4 AVC and HEVC, encoders have much more flexibility about referencing structures. They can use the same referencing structures as were previously used in older designs, or they can use more pictures as references and they can use more flexible ordering of the coding order relative to the display order. They are also allowed to use B frames as references when coding other (B or P) frames. This extra flexibility can improve compression efficiency, but it can cause propagation of errors if some data becomes lost or corrupted. One popular structure for use with the newer designs is the use of a hierarchy of B frames. Hierarchical B frames can provide very good compression efficiency and can also limit the propagation of errors, since the hierarchy can ensure that the number of pictures affected by any data corruption problem is strictly limited.[3]
Generally, the more I frames the video stream has, the more editable it is. However, having more I frames substantially increases bit rate needed to code the video.
Structure
The GOP structure is often referred by two numbers, for example, M=3, N=12. The first number tells the distance between two anchor frames (I or P), also known as the length of a "mini-GOP".[4] The second one tells the distance between two full images (I-frames): it is the GOP size.[5] Instead of the M parameter, the maximal count of B-frames between two consecutive anchor frames can be used; this is the approach used by ffmpeg.[6]
Examples:
- For M=3, N=12, the GOP structure is IBBPBBPBBPBB. There are 2 B-frames between two consecutive anchor frames.
- For the sequence IBBBBPBBBBPBBBB, GOP size N=15, anchor-distance M=5. There are 4 B-frames between two consecutive anchor frames.
The GOP structure does not need to stay fixed throughout encoding. Varying N to insert an I-frame on scene change is a well-known technique.[7] Newer techniques also vary M based on the amount of motion in the video.[8]
Additional concepts
With H.264 and later designs which allow highly flexible reference structures, a B frame in one GOP is able to reference a frame in a different GOP. A GOP that contains any such outward-referencing frame is known as an "open GOP". The opposite is a self-contained GOP, known as a "closed GOP".[4]
See also
References
- ↑ "Keyframes, InterFrame & Video Compression". 13 April 2021. https://blog.video.ibm.com/streaming-video-tips/keyframes-interframe-video-compression/#keyframe.
- ↑ "B-Frames". http://www.cs.cf.ac.uk/Dave/Multimedia/node258.html.
- ↑ "Hierarchical B-Frames or B-Pyramid - Video Compression". https://www.ramugedia.com/hierarchical-b-frames-or-b-pyramid.
- ↑ 4.0 4.1 Vijayanagar, Krishna Rao (17 December 2020). "Closed GOP and Open GOP - Simplified Explanation - OTTVerse". https://ottverse.com/closed-gop-open-gop-idr/.
- ↑ "Compressor 4 User Manual". https://help.apple.com/compressor/mac/4.0/en/compressor/usermanual/#chapter=18%26section=5.
- ↑ "FFmpeg Codecs Documentation". https://ffmpeg.org/ffmpeg-codecs.html. "bf integer (encoding,video) Set max number of B frames between non-B-frames."
- ↑ "Adaptive Intra-Frame Assignment and Bit-Rate Estimation for Variable GOP Length in H.264". IEEE Transactions on Circuits and Systems for Video Technology 16 (10): 1271–1279. October 2006. doi:10.1109/TCSVT.2006.881856. https://www.researchgate.net/publication/3308980_Adaptive_Intra-Frame_Assignment_and_Bit-Rate_Estimation_for_Variable_GOP_Length_in_H264.
- ↑ "Docs/Appendix-Adaptive-Prediction-Structure.md · master · Alliance for Open Media / SVT-AV1 · GitLab" (in en). 23 August 2023. https://gitlab.com/AOMediaCodec/SVT-AV1/-/blob/master/Docs/Appendix-Adaptive-Prediction-Structure.md.
 |  |
