H.264 efficiency

H.264 efficiency

H.264

H.264 takes video compression technology to the next level.

High Efficiency Video Coding H.264

The H.264 standard introduces a new advanced intra prediction scheme to encode I-frames. This scheme can significantly reduce the size (in bits) of an I frame while maintaining high quality by successfully predicting small blocks of pixels within a macroblock within a frame. It does this by trying to find matching pixels between the previously encoded pixels that constrain the new 4×4 pixel block for internal encoding. By reusing already encoded pixel values, the bit size of the data can be significantly reduced. The new intra prediction is a key element of H.264 technology and has proven to be very effective. For comparison: even if only I-frames are used in H.264 streaming, the resulting file size will be much smaller than for Motion JPEG streaming.
Illustrations of how some intra-prediction modes can be used when encoding 4×4 pixels within one of the 16 blocks that make up a macroblock. Each of the 16 blocks within a macroblock can be encoded using different modes.

H.264 also improves block-based motion compensation for P and B frame encoding. The H.264 encoder can choose to search for matching blocks (up to sub-pixels

precision) of some or many sections within one or more reference frames. You can also adjust the size and shape of the blocks to improve your search for matches. In areas where matching blocks cannot be found within the frame of reference, internally coded macroblocks are used. The high degree of flexibility of block-by-block motion compensation in H.264 is effective in high-density video environments where image quality must be maintained for the application. Motion compensation is the most requested aspect of a video encoder, and the various ways and levels in which it can be implemented with an H.264 encoder help improve the efficiency of video compression.

With the H.264 standard, typical blocky objects seen in highly compressed Motion JPEG and MPEG (as opposed to H.264) videos can be reduced with the built-in unblocking filter. This filter automatically smooths the edges of the blocks to produce a nearly perfect unwrapped video image.

conclusion
H.264 represents a major step forward in video compression technology. This standard offers various technologies to achieve better compression efficiency through the use of more accurate intra prediction schemes, as well as more robustness. It opens up new possibilities to create advanced video encoders that can significantly improve image quality, increase frame rate and resolution while maintaining the same bit rate (compared to previous standards) or, conversely, provide video of the same quality at a lower bit rate.

H.264 is the first example of a collaboration between the International Telecommunication Union, the International Organization for Standardization and the International Electrotechnical Commission on International Model Video Compression Standards. Due to its flexibility, H.264 has found applications in areas as diverse as high definition DVD (such as Bluray), video streaming including HDTV streaming, online video storage (such as YouTube), 3G mobile phone. , in programs such as QuickTime, Flash, and the MacOS X operating system on Apple computers, as well as on video game consoles such as PlayStation 3. With the support of many industries and software development,

With the wider adoption of the H.264 format in network cameras, video encoders, and video management software, system designers and integrators must be confident that their chosen products and vendors are compliant with this new open standard. Today, network video equipment that supports H.264 and Motion JPEG is the ideal choice, offering the highest degree of versatility and integration.

H.264 Profiles and Levels

H.264 Profiles and Levels

H.264

The joint group involved in defining the H.264 standard has focused on creating a simple and clear solution that minimizes options and parameters.

H.264

The most important aspect of this standard, as is the case with other video standards, is the provision of various capabilities within profiles (sets of algorithmic parameters) and levels (performance classes) to optimally support popular products and common formats. .

There are seven profiles in H.264, each of which is tailored to a specific application. Each profile determines which set of parameters the encoder can use and limits the complexity of the decoder implementation.

Network cameras and video encoders are likely to use a so-called baseline profile, designed primarily for use in areas with limited computing power. The baseline profile is best suited for use in modern real-time encoders embedded in network video equipment. This profile also provides low latency, which is an important requirement for video surveillance, and is essential for real-time control of pan, tilt and zoom of network PTZ cameras.

H.264 has 11 levels or degrees of limitation in terms of functionality, bandwidth, and memory requirements. Each level defines the bit rate and encoding rate in macroblocks per second for resolutions ranging from QCIF to HDTV and beyond. The higher the resolution, the higher the required level.

WHAT IS THE H.264 CODEC?

WHAT IS THE H.264 CODEC?

H.264

The H.264 codec is a further development of the MPEG-4 standard, also called MPEG-4 part10. In favor of H.264, at least the fact that high definition television (HDTV) works accurately using the H.264 standard speaks.

H.264

Compared to MPEG-4, the H.264 standard provides better compression due to the use of more complex stream encoding schemes. In scenes that are difficult to code with fast motion, color transitions are smoother and similar colors are compressed at a lower bit rate. This codec conveys fine details better, because unlike MPEG-2 and MPEG-4, where the minimum macroblock sizes are 16×16 and 8×8 pixels, H.264 uses blocks of up to 4×4 pixels and the block size changes adaptively for each individual fragment. In scenes with high details or fast-moving objects, this provides better image quality. With the same amount of information and image quality, the H.264 file is on average 30% smaller in terms of the size of the MPEG-4 file.

In the beginning, the obstacle to using this codec was that real-time video decoding requires very powerful hardware from the computer. Now, with the launch of Intel and AMD multi-core processors on the market, the required level of PC performance is available to a wide range of users.

AVC / H.264

AVC / H.264

H.264

The AVC (Advanced Video Coding) video compression standard was proposed by the JVT (Joint Video Team) in May 2003. At that time, it represented a revolutionary advance in video compression technology. The new standard completely surpassed the commonly used MPEG-2 and MPEG-4 Part 2 (SP, ASP) standards. By some estimates, storing video compressed according to the AVC standard requires 2 times less memory space than for video compressed according to the MPEG-2 standard with the same quality.

 

The new standard made it poH.264ssible to receive broadcast quality standard definition video at a rate of 1.5 Mbps. This compression ratio allows the transmission of approximately 12 compressed TV channels in the frequency band previously occupied by an analog TV channel. Additionally, the introduction of AVC enabled television operators to provide new video services in places where they were not previously available and opened up the ability to “pack” more video channels into a narrow and expensive frequency range for transmission. Advantages in encoding efficiency, such as good video quality at low bit rates, have made AVC the undisputed leader in Internet TV systems and have taken the industry to a whole new level. AVC has also significantly improved the quality of digital television and made HDTV high definition television widely available.

MPEG-LA’s low license fees have also contributed to the rapid adoption of the standard, and H.264 / AVC has successfully established itself in the market to date. In 2010, the number of AVC-based solutions exceeded the number of similar solutions based on the outdated MPEG-2 standard and increased every year until the adoption of the next H.265 / HEVC video compression standard.

Key features of the H.264 / AVC standard
The H.264 standard provides advanced encoding technology using methods similar to the previous MPEG and ITU-T standards. New tools that include the following provide increased productivity and quality.

Improved motion estimation

Motion estimation allows you to search for sub-macroblocks of various sizes from 16×16 to 4×4 pixels. Motion vectors are now accurate to 1/4 pixel for luma and 1/8 pixel for chroma. Furthermore, the coding of motion vectors has been significantly improved; your prediction is used.

Spatial prediction

H.264 performs internal predictions for intracoded blocks, allowing up to 9 different directional predictions to be applied.

Optimization of encoding parameters

The classical encoding method involves making optimal local decisions at each stage. Obviously, in this case, the resulting solution may not be optimal. The AVC standard proposes a new algorithm to optimize RDO (Frequency Distortion Optimization) encoding parameters, the essence of which is to select those parameters, the use of which will better affect the result.

Modified PrEP

To transform the residual information, a modified integer discrete cosine transform (MDCT) is used, which avoids rounding errors. One important difference from previous standards is the block sizes for DCT. AVC allows transformations in 8×8 and 4×4 pixel blocks.

Filter block limits

Another innovation of the AVC standard is the use of an unblocking filter, the main task of which is to smooth out block artifacts at the boundaries of macroblocks in the image. Thus, the visual perception of each frame and the entire video sequence as a whole is improved.

Enhanced coding on smooth movements

Several new conditions have been added to AVC to encode macroblocks in “jump” mode. In fact, in this case, the macroblock is not encoded, but a different macroblock is used in the same position but of a different frame. Therefore, significant gain is achieved at low bit rates or with smooth camera movements, when the entire image is moved in the same way.

Entropy coding

The standard provides two more efficient entropy encoding processes. Context Adaptive Variable Length Encoding (CAVLC – Context Adaptive Encoding with Different Lengths of Codewords) is an entropy encoder, the principle of which is close to the Huffman compression algorithm. CAVLC allows you to compress information quickly, while providing an acceptable compression ratio.

Context Adaptive Binary Arithmetic Coding (CABAC – Context Adaptive Binary Arithmetic Coding) is an arithmetic coder.

What is H.264?

What is H.264?

H.264

H.264 is the leading video compression standard used today in video surveillance and beyond.

H265  H264

H.264, MPEG-4 Part 10, or AVC (Advanced Video Coding) is a licensed video compression standard designed to achieve a high compression ratio of a video stream while maintaining high quality.

Created by ITU-T Video Coding Experts Group (VCEG) together with ISO / IEC Moving Picture Experts Group (MPEG) under the Joint Video Team (JVT) program.

ITU-T H.264 and ISO / IEC MPEG-4 Part 10 (the formal name is ISO / IEC 14496-10) are technically completely identical. The final draft of the first version of the standard was completed in May 2003.

It is used in HDTV digital television and in many other areas of digital video.

A little more about H.264 and why is it popular?

H.264 is a modern compression standard adopted in 2003. Thirteen years is a short time for an industry standard. For comparison, the first version of USB was adopted in 1995 and the second, which everyone uses now, in 2000.

Subscribe to the newsletter
It’s not rubbish! Only the latest news, articles, promotions and discounts. You can always unsubscribe.

Email *
SUBSCRIBE
The H.264 standard is reliable, compatible with almost any device, and provides good compression. HD quality video will be displayed at a bit rate of no more than 7-8 Mbps, while the previous standard (HD, MPG-2) required 12-20 Mbps, roughly double.

There is a more modern H.265 standard, but so far not everyone is ready to use it (developing codecs based on it is a bit more expensive for the software and hardware manufacturer, and the best is the enemy of the good), there is an outdated MPEG-2 (whose use requires more space in media, needs thick channels for traffic). Therefore, in our time it is so important for the universality of software and technology to maintain this compression standard.

H.265 is gradually being introduced to Hikvision cameras and recorders, with support for backward compatibility. This is how USB 3.0 (blue) is now being introduced, appearing more and more frequently on new motherboards and laptops.

H.264

H.264

H.264

H.264 (MPEG4 AVC) video compression standard features and related information: codecs, containers, playback, etc.
H.264 is a video compression standard adopted by the International Organization for Standardization (ISO). Also known as MPEG-4 part 10 and AVC (advanced video coding).

h264

Advantages of H.264

Compared to MPEG2 (DVD-Video) and MPEG4 ASP (DivX, XviD), H.264 compression works significantly more efficiently, providing better image quality (up to the level unattainable for MPEG2 and MPEG4 ASP) and a size smaller file.

Disadvantages of H.264

The main disadvantage of H.264 is the noticeably higher hardware requirements for encoding and playing video files.

For example, on a computer based on an Intel Pentium 4 processor clocked at 3.2 GHz, it is comfortable (no problem, no jerks) to use the ffdshow test decoder in Windows Vista, only the video is played in “medium” HD resolution – 1280 × 720. The so-called Full-HD video (1920 × 1080), depending on the complexity of the scenes, can already “slow down” noticeably. However, it should be noted that in Windows of the previous generation, XP, Full-HD video on the same computer is played quite smoothly in many cases.

The efficiency of using computer resources during playback depends to some extent on the decoder used.

H.264 decoders
ffdshow tests
A popular free decoder for many video and audio compression formats, including H.264.
CoreAVC
The paid codec is considered the codec that currently consumes the least resources. Since version 1.9.5, it supports decoding using the hardware capabilities of nVidia video cards through the CUDA interface. Modern versions also support the use of the hardware capabilities of ATI (AMD) and Intel graphics cards using the DXVA interface.
H.264 support
H.264 is accepted as a standard for compression of high definition video (HD, HDTV), it is distributed in a new generation of optical media: Blu-ray and HD DVD, it is used on mobile devices, it is compatible with Apple QuickTime, It is spreading in digital television transmission systems, videoconferencing, video surveillance, etc. The de facto standard for multimedia web applications and online video hosting sites like YouTube, Adobe Flash Player has supported direct playback of H.264 videos since version 9.0.115, released in late 2007.

Standards, formats, codecs, containers
The codec and the standard are not the same. A standard is a specification (description) of a compression algorithm (eg H.264), a codec is its specific software implementation (eg x264).

You should also not confuse the format of the data and the format of the container in which this data can be stored. The same data (eg compressed according to the H.264 algorithm by the x264 encoder) can be packed in different containers (eg Matroska, MP4 or AVI). In contrast, a container of the same format (eg MKV) does not have to contain video data in H.264 format; you can easily find a MKV file with a normal DivX video inside.

Data container formats
There are several common container formats, the main ones being MP4, Matroska (MKV), and AVI.

MP4
The official container standard for H.264 video. The main disadvantage of MP4 is that according to the specification, said file can only contain audio in AAC format. This leads to a forced loss of sound quality, for example when backing up DVD movies due to the need to transcode from one lossy compression format (AC3, Dolby Digital) to another (AAC). Purely technically, in an MP4 container you can place the stream of any format, but the ability to play the file on any player will not be guaranteed.
Matroska (Matryoshka, MKV)

AVI
The AVI container generally contains videos in the popular DivX and XviD (MPEG4 ASP) formats. The AVI container is not formally designed to store data encoded in accordance with the H.264 standard and is therefore not generally used for these purposes and in the rare cases of incorrect use of the container, the ability to play the corresponding files.

H264 – Bad Internet Video Quality?

H.264 – Bad Internet Video Quality?

H.264

Another common opinion based on materials that are often presented incorrectly or out of place. Here, as in the previous case, lack of practice and unwillingness to learn play a very important role. After all, you are just as likely to get poor recording quality due to the curves of the settings, both frame-by-frame and MPEG-like codecs. Many system vendors are squeezing quality to be able to record performance, which leads to this result. Most non-professional consumers also find H.2b4 video on the Internet, where it is highly compressed and intended primarily for a general idea of ​​the comic nature of the scenes or the situation in general.

H.264

Here again from the forum: “If, for example, a car is driving in the distance and its wheel falls off in motion, the codec can draw the whole machine from a long-playing keyframe in synthesized frames, along with the wheel that it is no longer there. ” This is possible only in case of a strong underestimation of the bit rate. The Internet is full of compressed entertainment videos, including accidents, and other situations related to video surveillance. It is very strange to consider the quality of this video, obtained, however, by compression in the H.264 format, equal to the quality of the file and draw some conclusions about the quality of the compression format in general. Can’t see the difference in the task of uploading videos to the Internet or recording a high-quality file?

Does H.264 consume more resources?

Many opinions on the subject of H.264 are promoted by individual manufacturers of network video cameras. For example, the article “The hidden cost of N.264”, which exists even in a video version, says that the cost of a solution in N.264 turns out to be significantly higher than that of MPEG or even frame-by-frame codecs. picture. In fact, the resource requirements for decoding video, especially multi-channel and high definition, will be slightly higher than MPEG-4, because all codecs are generally symmetric in terms of resources for encoding and decoding (in the sense, if the codec needs more resources to encode, and this is normal, since the more efficient the codec, the more resources are needed, even for decoding). The question is only on two points.

First, how much more demanding is H.264 on the computer CPU to monitor. Our practice shows that the load on the processor when decoding H.264 depends on the bit rate, however even at the maximum bit rate the download will be comparable to decoding a frame-by-frame JPEG (MJPEG) sequence. The authors of the article “The Hidden Cost of Н.264” focus on the higher cost of client stations and storages (as more and more efficient processors will be required), overshadowing a serious decrease in bandwidth requirements of the net. But even if we’re talking about 30% gain compared to slightly lagging MPEG-4, not to mention MPEG-2 and frame-by-frame codecs as well, isn’t 30% enough? Is it for small “safe cities”, where the rent from providers of data transmission channels costs 70 conventional rubles against 100 (the same 30%), is this a small saving? Or does it not matter that we can transfer 30% more cameras over the existing network?

Second, many “normal” network cameras (I mean more or less professional) are currently capable of transmitting video in two independent streams, with different resolutions, frame rates, and bit rates. And the “normal” software for these cameras also knows how to work with two streams. For multi-screen display, we can choose a low resolution sequence, for full-screen display, the maximum available, the change occurs automatically; the recording in the archive, of course, is done in high resolution. Perhaps you will say that I contradict myself, the second stream in each channel of the network and the saving of at least 30% are incompatible. However, I can assure you that with the correct settings, the second stream will not take up even 5% of the total bandwidth required.
Just go ahead
I’m not trying to act here as an advocate for H.264, I’m just not encouraging the hobbyist, for the fact that PR doesn’t rule reason. Everything must be appropriate for the task. If it is very important to you that your video is of the highest quality, if you want to be sure that it does not lose anything, ZIP is your assistant. Only lossless compression, which none of the codecs used in video surveillance will provide, will satisfy your requirements.

H.264. Some truth about delusions

H.264. Some truth about delusions

How does the widely used video compression codec 'H.264 / MPEG-4 AVC'  dramatically compress huge-sized movies? - GIGAZINE

This article is devoted to misconceptions, the constant distortion of facts, attempts to publicize competing compression technologies, and simply important points related to using the H.264 compression format. In video surveillance systems, of course,

How to Encode H.265 (HEVC) Video on Mac OS X

Although the general trend in the world is evident, some still try to defend their point of view at the cost of correcting these same trends. Well, I respect your point of view, unless it is based on a reluctance to study the subject or is simply a PR of your own technological solution. However, the second case is no less respectable, since protecting one’s interests is always good, even for the development of the industry; in this case, the dispute helps the consumer to better understand the correctness of the choice.

So what is it really about? It is already clear about video compression in H.264 format. But we will return to the controversy surrounding its use in digital video surveillance.
Mir and H. 264
Meanwhile, the world has chosen H.264. This is not an unfounded statement. Let’s see who uses this compression format. All and various. Let’s leave the perverse proprietary reviews on the conscience of the manufacturers, as even a good idea can be spoiled by a bad implementation. Let’s see, which of the manufacturers doesn’t use it? These are mostly megapixel IP video cameras, as the performance of the processors built into them is for the most part still insufficient to compress multiple megapixels in real time. Rather inexpensive processors with the ability to compress video in H.264 to a resolution of at least 2 megapixels have just started to appear on the market (yes, the widely advertised HDTV is only 2 megapixels, multiply 1920 by 1080 yourself). What can we say about the highest resolution? For the broad masses, focusing on the medium and low price segment, it will not be available soon. But there are more than enough hardware codec chips to embed in IP cameras with a resolution of D1 (720×576): here you have DSP processors and ASIC chips, and whatever your heart desires, today it is difficult to find a standard definition camera that does not support this format. …
Again time-lapse versus inter-frame
However, there are apologists who advocate other options for video compression. In his arsenal, arguments about better compression and the suitability of formats as evidence in court. But think about it, what does the court care, with what codec is it compressed? Is the compression format important to the court and not if the witness can confirm the violation and the expert can confirm the invariability of the video? Or maybe someone will argue that video compressed with a frame-by-frame codec is harder to switch (false) than one between frames? And the frame-by-frame codec doesn’t need a digital signature at all?

Both the magazines and the Internet forums are full of debates about the suitability and professionalism of the formats, and I am tired of reading absolutely unfounded “evidence” of this or that. The hobby is the main problem, an argument based on emotions, not arguments and mathematics. Let me give you a couple of examples.

There is a gigantic error based on the unwillingness to read the standards and generally study the device of even the simplest codecs. We are talking about the H.264 format and, in general, the methods of compression between frames.

“All the frames, except me, are synthesized, since they take information from the previous ones and simply indicate where to move this section of the image to a new location. That is, as if you selected a section of the frame in Photoshop and moved it to a new location. actually there is a frame that is not valid. ”

In fact, quite the opposite. It is the blocks in IP frames that are compressed when modified, and those that have not changed (that is, there was no movement) will remain unchanged. In general, the IP frame consists only of the modified information (blocks), which means that the information in them is not repeated, but is updated, but the l-frame is completely compressed, regardless of the changes.

Also there: “The codec uses psychophysical compression, that is, part of the image, which moves, becomes rough – all the small details are removed. This is because a person does not distinguish between details in fast-moving objects So does it make sense for a film codec to waste space and traffic to get details? “

What is the industry standard H.264 video encoding format for video compression?

The H.264 video compression standard is also known as MPEG-4 Part 10, Advanced Video Coding, MPEG-4 AVC, or AVC Video, and is an industry standard for video compression. It is one of the most popular video formats currently in use.

 H.265 vs H.264

In our digital life, we really come into contact with H.264 everywhere and the popularity of H.264 continues to grow. You can find this codec on, for example, HD DVD, HDTV, pay TV, or YouTube videos. And H.264 is not limited to consumer electronics. This format is also increasingly penetrating corporate communications IT.

H.264

Due to the growing popularity of H.264, it is estimated that by 2025, most conventional video distribution solutions that use HDBaseT or other proprietary transmission methods will be replaced by more flexible IP-based systems.

What is H.264?

H.264 or MPEG-4 AVC (Advanced Video Coding) is a video coding format used to record and distribute Full HD video and audio. This format was developed and maintained by the ITU-T Video Coding Expert Group (VCEG) together with the ISO / IEC JTC1 Moving Picture Expert Group (MPEG).

The H.264 format, which is commonly used for recording, compressing and distributing video content, is a network-compatible video transmission method that delivers high-quality images without consuming too much bandwidth.

Encoding and decoding with H.264

H.264 works by encoding (converting) HDMI (HD) audio and video signals into an IP stream that can be transmitted over an IP network. At the other extreme, the cable box converts the signals back to an uncompressed HDMI format. H.264 is so versatile because it allows you to transmit video signals from one encoder to multiple decoders at the same time. For example, you can transmit a set of video signals to a screen, a video wall, and a digital signage system at the same time.

H.264 applications: when and where can this format be used?

The H.264 video compression format is perfect for AV distribution to one or more video sources (multicast streams for multiple displays). A particularly suitable area of ​​application is the remote transmission of AV signals over existing cables and the Internet. It is currently in the process of moving to the standard video compression format, eg. B. for the video surveillance industry.

Applications include outdoor reporting (OB vans), energy sector, education, transportation sector, drone video recording to monitor the environment, as well as video wall processing, digital signage solutions and videoconferences.

The difference between H.265 and H.264

H.265 is the most recent variant of H.264 and is also known as High Efficiency Video Coding (HEVC) and MPEG-H Part 2. Compared to H.264, H.265 offers up to twice the compression of data with the same level of quality for video signals. It is designed to support future resolutions up to 8K UHD (8192×4320) (H.264 supports up to 4K (4092×2160)). Some newer devices, eg. Eg Some televisions, for example, have recently come with a built-in hardware decoder that plays H.265 content; however, the improved quality and reduced bandwidth usage come at a price. H.265 encoding and decoding require more processing power than H.264; therefore, the costs of H.265 solutions are significantly higher.

Benefits of using H.264 encoders and decoders

-Transmission with a low bandwidth requirement and a higher resolution.
-H.264 was developed to provide high quality transmission of full motion video with lower bandwidth requirements and lower latency than traditional video standards such as MPEG-2. H.264 uses a very efficient codec that delivers high-quality images and uses minimal bandwidth.
-H.264 bit rate is lower than other formats.
-H.264 has a bitrate 80% lower than Motion JPEG video. Estimated bit rate savings can be up to 50% compared to MPEG-2. For example, H.264 can provide better image quality with the same compression bit rate. Or the same image quality at a lower bit rate.
-Reduced video storage requirements
-H.264 requires much less storage space to store video content compared to other standards.