Metadata Types

Transform supports numerous types of sample based metadata. Each metadata type defines specific sample information and where that information is stored in the container. There are two categories of metadata:

  • metadata embedded in the media sample data (e.g. VBI, MPEG-2 user data, AVC SEI messages, etc.)
  • metadata stored in a seperate track or elementary stream (e.g. MXF 436M ancillary data, MOV captions, SCTE-35 splice information)

By default all available metadata in both categories is read from the input container and added to the appropriate samples. Similarly all sample metadata is written to the output container if supported by the container and stream formats.

Metadata Ordering

In many compressed formats (e.g. AVC and HEVC) video samples may be temporally reordered i.e. the samples are stored in a different order than they are displayed. Metadata elements are added to the video samples with a specific order based on the metadata type:

  • storage order metadata remains with the associated sample (i.e. the metadata is reordered for storage)
  • display order metadata is not reordered (i.e. the metadata is moved to different samples for storage).

The metadata elements are reordered when the stream is encoded, decoded or merged with a stream in a different order.

Metadata Tree

Each media sample contains a collection of root metadata elements. A metadata element may itself contain other elements forming a tree as illustrated below. The leaf elements of this tree contain the sample information.

209209

The example above illustrates an MPEG-2 transport stream containing an h.264 video elementary stream. Each video sample contains several root metadata elements:

  • ATSC A/72 Caption Data a72c stored in an AVC Supplemental Enhancement (SEI) message (in storage order).
  • SMPTE RDD11 Ancillary Data rd11 stored in a seperate packetized elementary (PES) stream (in display order).
  • SCTE-35 Splice Information sc35 also stored in a seperate PES stream (in display order).

The leaf elements representing the sample information include:

  • CEA-708 Closed Captions c708.
  • CEA-608 Closed Captions c608.
  • ATSC A/65 Caption Service Descriptor csd .
  • SCTE-35 Slice Information sc35 (also a root element).

Note that the metadata tree can contain multiple instances of the same metadata type (c708 in this case).

Metadata Operators

Use the Metadata Operators to attach or detach a leaf element to (or from) a specific root element.

Supported Types

Root

Leaf

Description

a53a

afd

ATSC A/53 Active Format Descriptor

a53b

bar  

ATSC A/53 Bar Data

a53c

c708

ATSC A/53 CEA-708 Closed Captions

a72a

a53a 

ATSC A/72 Active Format Descriptor

a72b

a53b 

ATSC A/72 Bar Data

a72c

a53c

ATSC A/72 CEA-708 Closed Captions

adm

Audio Definition Model (BS.2076-1)

atc

JCTVC-W1005 Alternative Transfer Characteristics

afd  

SMPTE ST2016-1 Active Format Descriptor

afdb

afd bar

SMPTE ST2016-1 Active Format Descriptor Bar Data

anc

anc6 ancc anca anct ancs ancd ance

SMPTE ST291 Ancillary Data

anc6

c608

SMPTE ST291 Ancillary Data C608 Packet

ancc

cdp

SMPTE ST291 Ancillary Data CDP Packet

anca

afdb

SMPTE ST291 Ancillary Data AFD Bar Packet

anct

time

SMPTE ST291 Ancillary Data Time Code Packet

ancs

sdp

SMPTE ST291 Ancillary Subtitle Distribution Packet

ancd

dvb

SMPTE ST2031 Ancillary DVB/SCTE VBI Packet

ance

s104

SMPTE ST291 Ancillary SCTE104 Packet

MDPM

time

SEI AVCHD Metadata

avc1

time

AVC-Intra SEI Message Type-1

avc2

anc

AVC-Intra SEI Message Type-2

bar  

SMPTE ST2016-1 Bar Data

c608

c618 c628

CEA-608 Closed Captions

c618

CEA-608 Closed Captions (Field 1)

c628

CEA-608 Closed Captions (Field 2)

c708

CEA-708 Closed Captions

cdp

SMPTE ST334-2 Caption Distribution Packet

cdpt

time

SMPTE ST334-2 Caption Distribution Packet Time Code Section

cdp7

c708

SMPTE ST334-2 Caption Distribution Packet C708 Section

cdps

csd

SMPTE ST334-2 Caption Distribution Packet CSD Section

clli

CTA-861.3 Content Light Level

csd

ATSC A/65 Caption Service Descriptor

cvt4

CTA-861.4 Color Volume Transform Type 4

difa

anc

DV/DVCPRO Ancillary Data

difc 

c608

DV/DVCPRO CEA-608 Closed Captions

dift

ltc

DV/DVCPRO LTC Time Code

divi

c608

Divicom MPEG-2 User Data

dovi

Dolby Vision (PHDR)

rpu

Dolby Vision Reference Picture Unit (RPU)

dvb

dvbt

DVB VBI Data

dvbt

ttxt

DVB Teletext

dvd

c708

DVD MPEG-2 User Data

ebp0

OpenCable Encoder Boundary Point (EBP)

ebif

OpenCable ETV Binary Interchange Format (ETV-BIF)

eiss

OpenCable ETV Integrated Signaling System (EISS)

esi

SMPTE ST328 Elementary Stream Editing Information

esvp

SMPTE ST328 ESI Vertical Phase Section

eshp

SMPTE ST328 ESI Horizontal Phase Section

est1

time

SMPTE ST328 ESI Time Code 1 Section

est2

time

SMPTE ST328 ESI Time Code 2 Section

espo

SMPTE ST328 ESI Picture Order Section

esvi

SMPTE ST328 ESI Video Index Section

esad

anc

SMPTE ST328 ESI Ancillary Data Section

eshd

SMPTE ST328 ESI History Data Section

escf

SMPTE ST328 ESI Flags Section

esud

SMPTE ST328 ESI User Data Section

gxfa

anc

SMPTE ST360 GXF Ancillary Data

sR!7

c608

SMPTE ST360 GXF CEA-608 Closed Captions

gxft

time

SMPTE ST360 GXF Time Code

gxtt

time

SMPTE ST360 GXF Track Time Code

gxst

time

SMPTE ST360 GXF Striped Time Code

sR!6

time c608 ttxt

SMPTE ST360 GXF VBI Line

gxfv

vbi

SMPTE ST360 GXF Vertical Blanking

ID3

ID3

ipv

IPV SEI User Data

ltc

LTC Time Code

lxfa

anc

LXF Ancillary Data

lxft

time

LXF Time Code

lxfv

vbi

LXF Vertical Blanking Interval

mdcv

SMPTE ST2086 Mastering Display Color Volume

movt

time

QuickTime Time Code Track

mov6

c608

QuickTime CEA-608 Closed Captions

movc

c708

QuickTime CEA-708 Closed Captions

goph

MPEG-2 GOP Header

gopt

time

MPEG-2 GOP Time Code

mp4a

anc

MPEG-4 Ancillary Metadata

mxfa

anc

SMPTE ST436 MXF Ancillary Data

mxfs

time

SMPTE ST377 MXF System Item Time Code

mxfm

time

SMPTE ST377 MXF Material Package Time Code

mxff

time

SMPTE ST377 MXF File Package Time Code

mxfp

time

SMPTE ST377 MXF Physical Package Time Code

mxfv

vbi

SMPTE ST436 MXF Vertical Blanking

neon

time c608 vbi

Omneon MPEG-2 User Data

rd11

anc

SMPTE RDD11 Ancillary Data

sdp

SMPTE RDD8-2008 Teletext Subtitle Distribution Packet

sc20

c608

SCTE 20 MPEG-2 User Data

sc21

c608

SCTE 21 MPEG-2 User Data

sc35

SCTE-35 Splice Information

s104

SCTE-104 Automation System to Compression System Communications Applications Program Interface

seaa

anc

Seachange Ancillary MPEG-2 User Data

seav

vbi

Seachange Vertical Blanking MPEG-2 User Data

pic

time

SEI Picture Timing

seit

time

SEI Time Code

soca

Sony Video Camera Parameters (SMPTE RDD 18)

tele

id3

Telestream MPEG-2 User Data

ttxt

EBU Teletext

t35

SEI T.35 User Data

time

ltc vitc

SMPTE ST12 Time Code

tiq

Telesteam IQ

tiqu

tiq

Telesteam IQ SEI User Data

uid

SEI Unregistered User Data

vbi

vbi6 vbit vbie

Vertical Blanking Interval

vbi6

c608

Vertical Blanking Interval C608 Line

vbit

vitc

Vertical Blanking Interval VITC Line

vbie

ttxt

Vertical Blanking Interval Teletext Line

vitc

vtc1 vtc2

VITC Time Code

vtc1

VITC1 Time Code

vtc2

VITC2 Time Code

x264

SEI x264 User Data

x265

SEI x265 User Data


Did this page help you?