WHAT IS THE H.264 CODEC?

WHAT IS THE H.264 CODEC?

H.264

The H.264 codec is a further development of the MPEG-4 standard, also called MPEG-4 part10. In favor of H.264, at least the fact that high definition television (HDTV) works accurately using the H.264 standard speaks.

H.264

Compared to MPEG-4, the H.264 standard provides better compression due to the use of more complex stream encoding schemes. In scenes that are difficult to code with fast motion, color transitions are smoother and similar colors are compressed at a lower bit rate. This codec conveys fine details better, because unlike MPEG-2 and MPEG-4, where the minimum macroblock sizes are 16×16 and 8×8 pixels, H.264 uses blocks of up to 4×4 pixels and the block size changes adaptively for each individual fragment. In scenes with high details or fast-moving objects, this provides better image quality. With the same amount of information and image quality, the H.264 file is on average 30% smaller in terms of the size of the MPEG-4 file.

In the beginning, the obstacle to using this codec was that real-time video decoding requires very powerful hardware from the computer. Now, with the launch of Intel and AMD multi-core processors on the market, the required level of PC performance is available to a wide range of users.

AVC / H.264

AVC / H.264

H.264

The AVC (Advanced Video Coding) video compression standard was proposed by the JVT (Joint Video Team) in May 2003. At that time, it represented a revolutionary advance in video compression technology. The new standard completely surpassed the commonly used MPEG-2 and MPEG-4 Part 2 (SP, ASP) standards. By some estimates, storing video compressed according to the AVC standard requires 2 times less memory space than for video compressed according to the MPEG-2 standard with the same quality.

 

The new standard made it poH.264ssible to receive broadcast quality standard definition video at a rate of 1.5 Mbps. This compression ratio allows the transmission of approximately 12 compressed TV channels in the frequency band previously occupied by an analog TV channel. Additionally, the introduction of AVC enabled television operators to provide new video services in places where they were not previously available and opened up the ability to “pack” more video channels into a narrow and expensive frequency range for transmission. Advantages in encoding efficiency, such as good video quality at low bit rates, have made AVC the undisputed leader in Internet TV systems and have taken the industry to a whole new level. AVC has also significantly improved the quality of digital television and made HDTV high definition television widely available.

MPEG-LA’s low license fees have also contributed to the rapid adoption of the standard, and H.264 / AVC has successfully established itself in the market to date. In 2010, the number of AVC-based solutions exceeded the number of similar solutions based on the outdated MPEG-2 standard and increased every year until the adoption of the next H.265 / HEVC video compression standard.

Key features of the H.264 / AVC standard
The H.264 standard provides advanced encoding technology using methods similar to the previous MPEG and ITU-T standards. New tools that include the following provide increased productivity and quality.

Improved motion estimation

Motion estimation allows you to search for sub-macroblocks of various sizes from 16×16 to 4×4 pixels. Motion vectors are now accurate to 1/4 pixel for luma and 1/8 pixel for chroma. Furthermore, the coding of motion vectors has been significantly improved; your prediction is used.

Spatial prediction

H.264 performs internal predictions for intracoded blocks, allowing up to 9 different directional predictions to be applied.

Optimization of encoding parameters

The classical encoding method involves making optimal local decisions at each stage. Obviously, in this case, the resulting solution may not be optimal. The AVC standard proposes a new algorithm to optimize RDO (Frequency Distortion Optimization) encoding parameters, the essence of which is to select those parameters, the use of which will better affect the result.

Modified PrEP

To transform the residual information, a modified integer discrete cosine transform (MDCT) is used, which avoids rounding errors. One important difference from previous standards is the block sizes for DCT. AVC allows transformations in 8×8 and 4×4 pixel blocks.

Filter block limits

Another innovation of the AVC standard is the use of an unblocking filter, the main task of which is to smooth out block artifacts at the boundaries of macroblocks in the image. Thus, the visual perception of each frame and the entire video sequence as a whole is improved.

Enhanced coding on smooth movements

Several new conditions have been added to AVC to encode macroblocks in “jump” mode. In fact, in this case, the macroblock is not encoded, but a different macroblock is used in the same position but of a different frame. Therefore, significant gain is achieved at low bit rates or with smooth camera movements, when the entire image is moved in the same way.

Entropy coding

The standard provides two more efficient entropy encoding processes. Context Adaptive Variable Length Encoding (CAVLC – Context Adaptive Encoding with Different Lengths of Codewords) is an entropy encoder, the principle of which is close to the Huffman compression algorithm. CAVLC allows you to compress information quickly, while providing an acceptable compression ratio.

Context Adaptive Binary Arithmetic Coding (CABAC – Context Adaptive Binary Arithmetic Coding) is an arithmetic coder.

What is H.264?

What is H.264?

H.264

H.264 is the leading video compression standard used today in video surveillance and beyond.

H265  H264

H.264, MPEG-4 Part 10, or AVC (Advanced Video Coding) is a licensed video compression standard designed to achieve a high compression ratio of a video stream while maintaining high quality.

Created by ITU-T Video Coding Experts Group (VCEG) together with ISO / IEC Moving Picture Experts Group (MPEG) under the Joint Video Team (JVT) program.

ITU-T H.264 and ISO / IEC MPEG-4 Part 10 (the formal name is ISO / IEC 14496-10) are technically completely identical. The final draft of the first version of the standard was completed in May 2003.

It is used in HDTV digital television and in many other areas of digital video.

A little more about H.264 and why is it popular?

H.264 is a modern compression standard adopted in 2003. Thirteen years is a short time for an industry standard. For comparison, the first version of USB was adopted in 1995 and the second, which everyone uses now, in 2000.

Subscribe to the newsletter
It’s not rubbish! Only the latest news, articles, promotions and discounts. You can always unsubscribe.

Email *
SUBSCRIBE
The H.264 standard is reliable, compatible with almost any device, and provides good compression. HD quality video will be displayed at a bit rate of no more than 7-8 Mbps, while the previous standard (HD, MPG-2) required 12-20 Mbps, roughly double.

There is a more modern H.265 standard, but so far not everyone is ready to use it (developing codecs based on it is a bit more expensive for the software and hardware manufacturer, and the best is the enemy of the good), there is an outdated MPEG-2 (whose use requires more space in media, needs thick channels for traffic). Therefore, in our time it is so important for the universality of software and technology to maintain this compression standard.

H.265 is gradually being introduced to Hikvision cameras and recorders, with support for backward compatibility. This is how USB 3.0 (blue) is now being introduced, appearing more and more frequently on new motherboards and laptops.

What is the industry standard H.264 video encoding format for video compression?

The H.264 video compression standard is also known as MPEG-4 Part 10, Advanced Video Coding, MPEG-4 AVC, or AVC Video, and is an industry standard for video compression. It is one of the most popular video formats currently in use.

 H.265 vs H.264

In our digital life, we really come into contact with H.264 everywhere and the popularity of H.264 continues to grow. You can find this codec on, for example, HD DVD, HDTV, pay TV, or YouTube videos. And H.264 is not limited to consumer electronics. This format is also increasingly penetrating corporate communications IT.

H.264

Due to the growing popularity of H.264, it is estimated that by 2025, most conventional video distribution solutions that use HDBaseT or other proprietary transmission methods will be replaced by more flexible IP-based systems.

What is H.264?

H.264 or MPEG-4 AVC (Advanced Video Coding) is a video coding format used to record and distribute Full HD video and audio. This format was developed and maintained by the ITU-T Video Coding Expert Group (VCEG) together with the ISO / IEC JTC1 Moving Picture Expert Group (MPEG).

The H.264 format, which is commonly used for recording, compressing and distributing video content, is a network-compatible video transmission method that delivers high-quality images without consuming too much bandwidth.

Encoding and decoding with H.264

H.264 works by encoding (converting) HDMI (HD) audio and video signals into an IP stream that can be transmitted over an IP network. At the other extreme, the cable box converts the signals back to an uncompressed HDMI format. H.264 is so versatile because it allows you to transmit video signals from one encoder to multiple decoders at the same time. For example, you can transmit a set of video signals to a screen, a video wall, and a digital signage system at the same time.

H.264 applications: when and where can this format be used?

The H.264 video compression format is perfect for AV distribution to one or more video sources (multicast streams for multiple displays). A particularly suitable area of ​​application is the remote transmission of AV signals over existing cables and the Internet. It is currently in the process of moving to the standard video compression format, eg. B. for the video surveillance industry.

Applications include outdoor reporting (OB vans), energy sector, education, transportation sector, drone video recording to monitor the environment, as well as video wall processing, digital signage solutions and videoconferences.

The difference between H.265 and H.264

H.265 is the most recent variant of H.264 and is also known as High Efficiency Video Coding (HEVC) and MPEG-H Part 2. Compared to H.264, H.265 offers up to twice the compression of data with the same level of quality for video signals. It is designed to support future resolutions up to 8K UHD (8192×4320) (H.264 supports up to 4K (4092×2160)). Some newer devices, eg. Eg Some televisions, for example, have recently come with a built-in hardware decoder that plays H.265 content; however, the improved quality and reduced bandwidth usage come at a price. H.265 encoding and decoding require more processing power than H.264; therefore, the costs of H.265 solutions are significantly higher.

Benefits of using H.264 encoders and decoders

-Transmission with a low bandwidth requirement and a higher resolution.
-H.264 was developed to provide high quality transmission of full motion video with lower bandwidth requirements and lower latency than traditional video standards such as MPEG-2. H.264 uses a very efficient codec that delivers high-quality images and uses minimal bandwidth.
-H.264 bit rate is lower than other formats.
-H.264 has a bitrate 80% lower than Motion JPEG video. Estimated bit rate savings can be up to 50% compared to MPEG-2. For example, H.264 can provide better image quality with the same compression bit rate. Or the same image quality at a lower bit rate.
-Reduced video storage requirements
-H.264 requires much less storage space to store video content compared to other standards.

The different types of format for H.264

While H.264 is often considered a single format, there are many different types of H.264 formats. Each of these different types of formats has performance advantages and disadvantages. In recent years, most IP camera manufacturers have supported only the most basic type of format – the basic line profile. Now, manufacturers are increasingly supporting the more ‘advanced’ format types, including high profile and main. In this article, we share the results of the baseline profile tests against the largest profile differences in bandwidth and hardware (CPU) usage.

h.264

 

H.264 background

Manufacturers of IP cameras have widely standardized H.264 codec as the selected video surveillance codec. Because virtually all video surveillance systems need compression, codecs are indispensable. Previously, MJPEG and MPEG-4 were the most widely used. Today, the most widely used is H.264. In the last few years there has been a hot debate over the use of MJPEG or H.264, but H.264 certainly offers very interesting bandwidth savings.

h.264

Basic vs. Main line H.264 profile

Of the many H.264 profiles, the two most commonly used for video surveillance are the basic and main line. The baseline profile is generally considered the least effective of the H.264 profiles, but also the least demanding in terms of hardware resources. In contrast, the main profile is considered effective in bandwidth consumption, but also more demanding.
Increasingly, newer IP cameras use the main profile by default, while the generation 2-3 years ago would be more likely to use the basic profile.

Questions to be solved with the tests with h.264

IPVM performed a test in 3 different scenarios – during the day, at night and in high traffic complexity. For measuring the differences in bandwidth usage and hardware utilization (CPU) for base and main line H.264 profiles.

The questions they asked were the following:

How much bandwidth savings, if any, would you have with the main profile compared to the baseline?
How much bandwidth savings would you have depending on the stage type?
What is the increase in hardware consumption (CPU) when using the main profile instead of the basic line profile?
Should we prefer a main profile camera rather than a basic line profile camera?
Main conclusions and answers
The bandwidth limitation is modest. The main profile reduced bandwidth consumption by 10-30% in all three tests.

In all three tests, no noticeable difference in hardware consumption (CPU) was observed between the base profile and the main profile.

The tests were also performed using MJPEG. Bandwidth usage was 10 to 100 times more than the main profile.
Furthermore, it was also very interesting that the hardware consumption (CPU) was generally significantly higher than any of the H.264 sequences.

H.264 explained – Mp4 format

Video formats for the Internet: MP4 and its variants, MP4 / H.264 and MP4 / MPEG-4 – Differences and similarities

The videos that we play online or locally on the computer or any other device may be coded in different ways. Each method of encoding them has its advantages and disadvantages, and there are better formats than others, depending on the use we will give to the video. We have formats such as AVI, MP4, MKV, 3GP, Google WebM, etc. …

h.264 explained mp4

When playing video on the Internet using a browser, the most widespread format and with the best support from browsers, both mobile and desktop, is the MP4 format, and to be more accurate the MP4 / H format. .264, which corresponds to files that normally carry the .mp4 extension. but:

Are all .mp4 files the same?

If they are not similar, what types are there? What are the differences, advantages and disadvantages of each one?
Are they all on the Internet?

MP4 format – Parts, containers and extensions

When we talk about a .mp4 file or MP4 format in general, what we are talking about is what is technically called MPEG-4, part 14. It is a standard format (ISO / IEC 14496-14) and it is a container format for multimedia tracks. That is, this format defines how audio and video tracks (called data streams) can be contained in the file in various formats and may even contain subtitles.

In this container format within the .mp4 file, the audio and video tracks can be encoded in different formats, as appropriate for the application to be provided. While in theory it supports many different formats (almost any) for these audio and video tracks, in practice players of this format only support some specific types, the most frequent being:

Audio: AAC (Advanced Audio Codec, which when released is files with extensions .m4a or .3gp) or MP3 format.
Video: the different variants of MPEG format.
MPEG or Moving Picture Experts Group is a group of “authorities” and audio and video manufacturers that came together at the request of ISO in the late 1980s to create file coding standards for this type of multimedia information, ensuring compatibility between the media to be played, and the playback devices. The first version of the standard, MPEG-1, came out in 1993, and since then there have been many new versions, and within what they call “Parts”, which are specific aspects of the standard and also extensions to the specification of specific things, or improvements to the basic format they are changing.

h.624 mp4

The most prevalent version of this MPEG format is 4 or MPEG-4, which appeared in late 1998, and this is what we know as MP4, due to the expansion of its files. This version is divided into several sub-standards or “Parts” that describe certain format issues (such as the 14 container, as I said at the beginning) and some extensions.

Within parts of the standard, part 10 describes an advanced coding format, that’s what we also know as H.264, but it’s actually also called MPEG-4 part 10, and that’s what Blue-Ray discs used for example. That is why they talk on many internet sites that the H.264 and MPEG-4 are the same. And this is true, but not quite, as parts 2, 12 or 14 of MPEG-4 also describe other compression formats that are MPEG-4, and the container format may also contain MPEG in earlier versions of lower quality such as MPEG -1 or MPEG- 2nd

MPEG-4 part 10 or H.264 or AVC format

Let’s summarize what we know so far: When we talk about MP4 or .mp4 files today, or the “MP4 format”, we’re really talking about the container format. Within this, there may be audio and video in various formats, so only talking about MP4 is not correct (or at least it is not accurate) and more details are needed. Given that the format used to compress the video stream containing MP4 is of vital importance, “last name” for that format is usually set to indicate well what we are referring to.

Thus, reference is made to MP4 / H.264 for videos using MPEG-4 part 10 and which are very high quality compatible videos. It is also common to talk about the MP4 / MPEG-4 format, which in this case usually refers to part 2 of the MPEG-4, which is the original format that was released and is of lower quality so it is usually used for broadcasting IP TV (video surveillance) or distributing certain multimedia content (some “pirate” movies, multimedia CDs …) as it generally weighs less.

The MP4 / H.264 format is what should be used to play directly in browsers, as this is what everyone supports today in all operating systems. It is much more efficient than MPEG-4 part 2 (the original) in coding and offers much better quality, even if we use a low bit rate or reduced bandwidth when reproducing it. It resists transmission failure very well, although some packets are lost, so it works very well for streaming, video conferencing and similar applications. This format is also called AVC (Advanced Video Coding), so sometimes you can read MP4 / AVC, but it’s the same.

By contrast, the H.264 format is more complex and more complicated to code (it may require up to 3 times more computing power than the original MPEG-4 format) and to decode (twice as much power), but today with the devices that the average user has (both computers and mobiles, etc.), this is of little importance.

In summary

Just talking about the “MP4 format” is imprecise. One video with the .mp4 extension may not play in one browser, while another with the same extension does. The difference between them is in the way of encoding the video inside, as .mp4 is a container format.

On the web, the recommended format is MPEG-4 part 10, or what is the same as MP4 / AVC or, much more commonly called, MP4 / H.264. This format works in all browsers on the market, except in very old versions of Internet Explorer.

So when they talk to you about the “MP4 format”, they either talk about MP4 / H.264 or they have to specify it more. If you are unsure about the format of a particular .mp4 file you want to play, you can use a tool like Media Info to tell you how the audio and video tracks are encoded. This program identifies tracks coded as H.264 as AVC, which as we know is the same. If AVC tells you, it’s in the right format for the Internet.

As you can see, the world of multimedia formats is quite complicated technically. Fortunately, as a developer or web designer, all you have to worry about today is that they have an appropriate quality / weight ratio and are coded as MP4 / H.264. So you have it easy