What Metadata Rides Along With A Video File

A video file contains more than compressed pictures and sound. It carries a body of descriptive information that determines how those pictures are interpreted and displayed.

Some metadata is required for playback

The container must state which codec each stream uses, at what resolution, and how many frames per second. Without those declarations a player cannot begin decoding.

Timestamps establish when each frame and audio packet should be presented. They keep picture and sound aligned even when the two streams are encoded at different intervals.

An index maps time positions to file positions so seeking is possible. When it is missing or damaged, a file may play from the beginning yet refuse to scrub.

Display flags change the picture without changing pixels

Orientation is commonly recorded as a rotation flag rather than by rotating the stored pixels. The picture is stored one way and instructed to be shown another.

Software that ignores the flag displays footage sideways, which is why a phone recording sometimes appears rotated on a computer but correct on the phone. The pixels are identical in both cases.

Aspect ratio behaves similarly. A file can declare that its pixels are non-square, so a player stretches the stored grid to the intended shape.

Color information tells a display how to interpret values

A stored value of, say, mid-gray means nothing until you know which color space and transfer characteristics were assumed. Tags declare those assumptions.

If tags are absent, players guess from resolution and era, and the guess is often wrong. Washed-out or oversaturated playback frequently traces to a missing or incorrect color tag.

High dynamic range depends on this signaling absolutely. Without correct tags a display treats an HDR signal as ordinary and produces a dim, flat picture.

Descriptive fields are for people and systems

Titles, creation times, camera identifiers, track languages and chapter markers are recorded for human and software use rather than for decoding. Playback continues without them.

They matter enormously for organization. A library with reliable creation times and track languages can be sorted and searched; one without them requires opening files to find anything.

Location data is often recorded automatically by cameras and phones. It travels with the file when shared, which is worth knowing before distributing footage.

Metadata is easily lost in processing

Many conversion operations copy the picture faithfully and discard everything else. Rotation flags, color tags and timestamps are common casualties.

The symptoms are confusing because the picture data is intact. Footage plays sideways, looks wrong, or reports the wrong date while the frames themselves are unchanged.

Checking a converted file's declared properties against the original catches these losses immediately. The alternative is discovering them at the far end of a workflow.