Video formats and compression codecs for video editing


Free Download Mp4Gain
picture

To understand the basics of video editing, one must consider display frame theory. For this reason, we will often use a fitting comparison in the guide: that of motion pictures and the frames that make up the film.

Video Editing

What is a video format?

We all know that you need a screen, a projector, and a movie to get a movie projection. A sequence of images is printed on the film, translucent as the negatives of the photographs, which in the projection modify the light beam of the projector, allowing only certain parts to pass through, which will generate an image on the screen. Film flows, projected images change rapidly, and a motion effect is obtained.

Let’s go back to digital video.

Let’s say we have a series of images that reproduce a movement (we will see later how the capture phase, or video capture, allows this). These images alone are not enough to show a movie on our PC. In fact, we should be able to tell the machine where these images are, what type they are, how fast they should be viewed, and in what order. For this reason, the format of a clip is defined, that is, a kind of “container”, recognizable by the PC, in which the previous information is attached, in addition to the images.
To recognize a video file format of a clip, you can access the file properties panel or observe the file extension itself (for example, AVI, MPG, QTM, etc … all video extensions).

Digital video
Each editor chooses the best video format they consider appropriate, depending on how they work, the technology they have available and the end result they want to achieve.

In fact, try to think how much a color image of about 800×600 pixels takes up. So much … too much to see 25 per second (as the theory of optics says) and save them to our HD.

What is a video codec?

This is where the codec (COmpressor DECompressor or better DECoder CODER) comes in, or the software that contains the mathematical procedure through which the images are compressed (often with loss or loss of information) to allow agile management and reproduction correct clip.
In practice, compressed video formats are obtained.

The codec is used both to capture and compress the video from an external source, and to play and process the video once it is stored on the hard drive. It could be compared to a kind of very fast Winzip that, if necessary, compresses and decompresses the images of a film.

It is useless to dwell on how a codec manages to make a noticeable decrease in the space occupied by images, reducing the loss of quality to a minimum (sometimes surprisingly!) What little indication to say which is the best video codec or the best compression Of video . The answer is always the same: it depends on what you want to achieve (and, similarly, what is the best video format is a question that has multiple answers).
The important thing is that these codecs are available to us, there are many of them and each one has peculiar characteristics that suggest its working environment.

We suggest downloading the K-Lite Codeck Pack (often also abbreviated as Klite) which contains an important collection of useful and cross-cutting codecs, tools, formats and filters.

Structure of a video format

Hardware codec and analog capture

Until recently, analog capture cards (especially M-Jpeg) were almost all equipped with a proprietary chip that allowed smooth, lossless capture as it took the computer’s processor out of compression work (it’s this chip that kept the price of the cards high).
The hardware codec is still software, but it interacts with this chip by letting the system know that it exists and that it can do the job instead of the CPU.
Without the codec installed, the card chip is useless, whereas if only the software codec is installed, the PC processor may be able to do the compression job, but this in particular cases.

Entry-level PCs are still powerful, and often analog acquisition cards only have one analog-to-digital conversion chip, while the processor does the conversion. In some cases, it is even possible to capture with very complex and elaborate software codecs like DivX or Xvid.
It is clear that choosing the hardware codec is always recommended, as in the case of the MPEG2 capture which requires a lot of resources.


Free Download Mp4Gain
picture


Mp4Gain Main Window
picture


Mp4Gain Features
picture


Free Download Mp4Gain
picture

Video codecs

In photography, the choice of the recording codec is quite limited: we usually fluctuate between the JPG format and the Raw format. In video, the choice is slightly wider: MPEG-1, MPEG-2, MPG-4, H264, H265, RAW, ProRes, ProRes Raw, Motion jpeg, etc.

So what are these codecs for, what uses are they designed for, and which ones should you choose?

Códecs

CONTAINERS AND CODECS are NOT the same!

Digital videos are contained in files. These files are called “containers”. The extension of these files often makes it possible to determine their type. The most common containers are MP4, MOV, AVI and MXF. The MXF container is generally used in professional camera series from manufacturers such as Sony or Panasonic.

These containers are “boxes” or “folders” that consist of several elements: video track, sound tracks, time code or subtitles. The purpose of the container is to synchronize all the elements it contains.

Therefore, you cannot know the codec of a video from the file extension: for example, an .avi file and a .mov file could use the same codec to encode the video track.

WHAT IS A CODEC?

A codec is a mathematical procedure consisting of algorithms used to encode and decode the image (codec). It helps define how sensor information is stored and the strategy for compressing and decompressing images.

codec

The size of a one minute 4K video file is about 50 GB. Therefore, it is easy to understand the main advantage of using a codec: compression. For the same minute of 4K recording, for example, using the H264 codec reduces the file size by a factor of about 27, or a final size of about 1.8 GB.

The more “codec” a codec is, the more complex the decoding will be and it will require a powerful machine to accomplish this task. At the same time, the higher the compression, the greater the loss of information that can make post-production difficult.

To achieve this optimization, most codecs use spatial compression: each image is compressed independently of the other images; This is known as an “intra” codec. For more compression, more complex codecs add temporary compression: we’re talking LONG GOP (GOP for “Group of Pictures” or “Long Group of Pictures”); Codecs of this type record only one full image per x images (often 12) and retain only what has changed between these images.

What is a codec exactly

What is a codec exactly

Has it happened to you that you download a video file and then you cannot use it in your player? Or that you finally finish editing your video clip and it takes years to upload to the Internet? You might think it is a problem with your file. You are not wrong, only the question is more specific: it is about the codec and container you are using.

Maybe they are somewhat strange terms, but they are gaining more and more popularity due to the growing community in online video and audiovisual production. So if you plan to start your career as a youtuber, take into account the information, because if you end up with a final video with a weight of 1 GB it will not be fun waiting for it to go up …

What is a codec?

Those who do video editing know full well that storage space can be a problem. It is better to have the material you record in its original format, but most of the time this involves a considerable amount of GB of space. For example, if you record an hour of content with an HD camera, you may need … up to 410 GB! This is difficult to keep it, much more if you want to transmit it to other media. This is where the topic gets interesting.

The term codec refers to the video or audio compression and decompression process. It is a tool that encodes video using algorithms and converts it into information. This way you can decrease the file size.

The choice of the codec depends on different factors. You must mainly take into account the means of reproduction for the final product. However, encoding is not enough for its reproduction, it is also required to “pack” the information in order to present it. We are talking about containers.

What are those containers?

Suppose you just finished editing a video. The final file contains both images and audio, so you require a way to display it just as you prepared it. This “package” is basically what many refer to when they talk about the format of a file. So a container can accept different codecs, while players can use certain containers. For example, the VLC player accepts almost all containers.

Lossy and lossless codecs (lossy and lossless)

There are different types of compression, as we will see later. However, all of them can be divided into two categories: with or without loss. Loss of what? Quality. For example, in the case of audio files, it is not the same to listen to a song in FLAC (Free Lossless Audio Codec) format to one in MP3 (MPEG Audio Layer III). The first is coded in such a way that almost no information is lost when compressing, that is, fidelity is maintained.

The same goes for the video. Wanting to save storage space, lossy files, ie lossy, are compressed. This makes them much easier to manage. However, it is unavoidable to deal with data loss and therefore image or audio fidelity. On the other hand, when you want to maintain the highest possible quality and have no space problem, lossless or lossless compressors are used. Again, it all depends on the purpose of your file. Will it be a web video? A projection? Film contest?

Video codecs

Below you will find a list of the most popular codecs. We will not go too far into others, since an average consumer rarely requires those who are specialized.

DV and HDV

Do you remember the tapes or cassettes to record video? This type of capture uses the DV codec, the standard defined by various electronic sales companies. Over time, HDV emerged, as they had to adjust to the demand for high-definition video.

H.264 / MPEG-4 AVC

Platforms like YouTube have made the popularity of this codec grow quite a bit, as it is their recommendation to upload your videos. It is one of the most suggested thanks to the fact that it considerably reduces the file size without sacrificing much image fidelity. Multiple cameras use the codec, as do web video and Blu-ray.

Microsoft VC-1

Microsoft has its encoding mode for Blu-ray content. It also works in your Microsoft Silverlight tool.

MJPEG (Motion JPEG)

Many video cameras used to capture material with this codec. Its name comes from the group that created it, the Joint Picture Experts Group. If the name seems familiar to you, it is because they are the same ones that created the JPEG still image compression codec.

MPEG-1

Before H.264 there was MPEG-1. This used to be the standard for online video, although the emergence of new formats has left it behind.

MPEG-2

This format is merely for compressing information to DVD video.

WMV (Windows Media Video)

This is another codec that has practically disappeared. It focuses on the Microsoft family.

 

Audio codecs

As we mentioned before, codecs can be used with or without data loss. As for audio, there is a huge difference not only in quality (especially with good headphones), but also in the file size. Do you prefer an entire album in MP3 or a few songs in FLAC?

ACC (Advanced Audio Coding)

YouTube, Android, iOS, iTunes and more have adopted this compression method as their standard. AAC was devised as the next step for MP3, although it still has a long way to go. However, AAC tends to be of better quality. It is a lossy codec.

FLAC (Free Lossless Audio Codec)

Recommended for true audiophiles. Its development is open source and is considered a great alternative to MP3 or CD if you want to get the best possible quality. It is also recommended because it can compress a file by up to 60% without loss of information.

MP3 (MPEG-1 Audio Layer 3)

It is currently the best known format for audio. It is not of the best quality, but its compression quality is what has made it so successful. It ignores the information that corresponds to the sounds that we do not hear in our hearing range, thus eliminating “irrelevant” space. It can be reduced between 75 and 95% of the original size.

Windows Media Audio (WMA)

This is another of Microsoft’s products. It never really took off, the MP3 format took care of it. It has two versions, one with and without loss of information, although the same extension (WMA) is used for both.

Containers

You have finished editing your video. You have already chosen the codec and now you must choose the means by which you can transport and reproduce the information you have assembled. We leave you the best known. Define which one is indicated according to the purpose of your product.

ASF (Advanced Systems Format)

This is a format that belongs to the Microsoft family. Its supported file types include .asf, .wma, and .wmv. The container works well if your devices are Microsoft, but it is not well received by other systems, not to mention the loss of popularity with other containers.

AVI (Audio Video Interleave)

We have all come across this one in one or the other download. It is still in multiple instances, but don’t consider it your first (or second) option if you’re creating content.

AVCHD

This format works with the content captured with video cameras.

Flash

Adobe has its own container, which was originally created by Macromedia. Many have made it clear that it is a limited container. For example, Mozilla Firefox no longer supports such files.

MKV (Matroska Multimedia Container)

This format increasingly gains more ground thanks to its versatility. It accepts almost any audio and video codec. It also has the ability to have multiple video, audio and text channels. It is open source, so it has a generous community.

MP4

It is one of the most popular containers. It works with the H.264 codec, making it ideal for working with online audiovisual content. As for audio, it usually uses AAC or AC3 codecs. It was created by the Motion Pictures Expert Group.

MPEG and BDAV MPEG-2

Both are used for discs, the first for DVD and the second for Blu-ray. Generally the file extensions with this codec are TS, VOB, MPG and SVCD.

Quicktime

Now we see the turn of the Apple family. Part of its appeal is the separation of information into different channels (video, audio and text). It also allows for better editing of the metadata. It compares a lot with the MP4 container.

Codecs: How an audio or video codec works

To understand in a simple way what a codec is and how it works, the first thing we have to keep in mind is that the human voice is a continuous (analog) waveform, while the information that circulates through a data network is discrete ( digital). This means that if we want to send packets with data that contain the information needed to reproduce a voice fragment, we will have to digitize the voice beforehand.

codecs

The process of converting an analog signal to a digital signal is done through an element called an encoder. If the encoder is also capable of performing the opposite process, that is, moving from a digital signal to an analog signal even if only approximately, then we will have an encoder-decoder. An encoder-decoder is also called a ‘codec’.

Although it may seem that we would only be interested in selecting one or two codecs taking into account the voice quality (MOS, Mean Opinion Score) and bit-rate parameters that each codec needs, the truth is that we also have to face our network Look closely at the size of the packets that we are going to send since each voice packet is also made up of bits that are used for routing and error correction issues. As they add load, they saturate the network and make the entire system go slower. Do we reduce the number of packages we have to send making them larger? It is not always a good idea because the loss of a large package will have a greater impact on the output, even a cut in communication! What is recommended in these cases is to have a certain compromise between the number of packets that are sent to the network and the protection we want to have. The reference size should be about 20ms of voice per package.

codecs

How codecs work

The codecs reduce the information of the clips to facilitate and enable their publication and viewing through the Internet. There are two methods of compression, the so-called spatial and temporal compression.

In the first one, reduce the information by compressing the existing one inside each frame. Instead of describing the pixel-to-pixel image, pointing out for example the position and color of the pixels, the compression codec generalizes describing similar areas and their light and color characteristics. For example, instead of reproducing a blue sky pixel by pixel, it would be described as an area with similar light and color characteristics. In this sense, the less varied details an image presents, the codec can generalize and compress more easily. Creating videos with simple backgrounds facilitates compression and reduction, just as working with a tripod instead of a camera in hand means stabilizing the backgrounds and therefore facilitating subsequent compression.

The other compression method is temporary, where the information between consecutive frames is compared and only the details that vary are stored. The reference frames from which the differences are analyzed and the subsequent ones are supported are called keyframes and contain the complete image. On the contrary, the frames that reflect the differences are called “delta frames” and only contain the information of the areas that vary with respect to the previous images.

In general, videos that show few changes between frames are compressed better and this necessarily affects the realization. At present, both the television and the cinematographic realization tend to use the camera in motion. However, the compression of dynamic videos is more problematic than the cases of more static images.