header
gray shim

T351 - Summer Week 5

Agenda / Reality check

  • This week:
    • Any missing Final Project pre-production work MUST be turned today/ASAP to receive any credit. This is 20 points of your Final Project grade. Don't forget to turn in your Storytelling Project critiques by Thursday. I'm interested to read how the group dynamics worked.
    • This week there is no lab Wed or Thursday. The time is dedicated for you to work on Final Projects. However I will be available to meet with you individually. Please contact me today to schedule one-on-one time if you need it.
    • Don't forget about the Multimedia Exercise, which is due by Monday, June 11. I'll cover exporting for this today.
  • Next week (week 6) is the last week of class!
    • Final Quiz will be next Tuesday (6/12). The lab will be devoted to editing
    • Wednesday - View Final Projects. There are no camera checkouts next week (Sunday is the last day to check out a camera).

Lecture & lab today:

  • Codecs & Multimedia Architecture
  • Format Conversion
  • Film to Video transfer
  • Digital Video & High Definition Broadcasting
  • Metadata & subtitles
  • Resources for Post-production
  • Final Exam Review

Readings:

Final Projects: review criteria

All of your written materials (except for storyboards) should be typed. The amount of detail along with the appearance and presentation of your materials & packet affects your grade.

  • These were due last week, but I extended the time for some of you.
  • Yes, you CAN script feature stories and documentaries. Scripts are expected for all projects.
  • Talent release forms can be found on the T351 website.

 

Video & Multimedia

Video from a non-linear editor often needs to be converted for uses other than television.

Other uses include:

  • DVDs
  • Video games
  • Software
  • Internet/Intranet
  • Video conferencing

Each of these applications use different codecs. It's important to understand the difference between multimedia systems or architecture (the container) and codecs, which are specific file types. Codecs are designed for specific purposes. Some are optimized for delivery, some are best suited for editing.

Two popular mutlimedia systems include Windows Media and Apple Quicktime. Both of these systems support a number of different codecs.

The Internet supports many competing architectures: Windows, Quicktime & Real.

Websites often offer video at vaying bandwidths depending on your connection speed, but often use just one of the three architectures. You've discoveed this if you've ever found that you couldn't play video from a website untll installing the right plug-in for your browser

Examples:

  • MTV uses Windows media.
  • CNN uses Real
  • Apple uses Quicktime
  • YouTube uses Flash

Software such as Apple Compressor, Adobe Media Encoder, Sorenson Squeeze, or Flip4Mac can take a movie and output it in a variety of formats and resolutions. Most allow for batch processing. You could use it to make three different versions of a movie, each for a different purpose (web, SD DVD & BluRay). In many cases you can export your video directly from your editing software into the appropriate codec. Sometimes you need specialized or proprietary hardware or software in order to make the codec in a different multimedia architexcture.

Exporting for mass consumption: DVD & web.

2 popular codecs:

  • Standard-definition Video DVDs use the MPEG-2 codec
  • H.264 is a wonderful multipurpose delivery codec
  • Blu-ray disks can use MPEG-2, MPEG-4 and SMPTE VC-1

If you are exporting movies for non-broadcast uses (E.g. for DVD or YouTube), always add at least a half second of black at the beginning before the program fades up from black. This gives a chance for the player to lock onto the audio. If your audio starts instantaneously, the first few milliseconds of audio will likely be cut off.

Fade to black at the end and add at least a few more seconds of black. This way your DVD won't immediately jump back to the menu. It gives just a moment to conclude the ending.

In your sequence/timeline, set an in-point at the beginning and an out-point a few seconds after the fade out at the end.

From the "File" menu, choose "Export -> Using Quicktime Conversion"

For the web:

  • iPod works OK- usually it seems to automatically get the pixel aspect ratio. But to be safe, I use a custom size, putting it in square pixels.
  • I usually use MPEG-4 (or H.264) for at a high quality setting. If the file size is too large, I dial the data rate back

 

Video Codecs - Interframe verses Intraframe

Only the highest end video is uncompressed. Almost all video (especially HD) uses some sort of compression. When looking at the characteristics of various video recording gear, it's important to understand the basic differences between two general types of compression.

Most standard definition production tv codecs use some type of intraframe compression. This is where we take each individual frame and squeeze it so it all fits onto tape or disk. Examples of intraframe codecs include:

  • Apple ProRes
  • Avid codecs (AVR25, AVR 50, etc.)
  • DV
  • DVCProHD
  • Panasonic D5

The nice thing about most intraframe recording is that it can be compressed and played back in real-time using inexpensive hardware.

However many new HD recording formats use interframe or Group of Pictures (GOP) compression. The important thing to understand about interframe compression is that it compresses over time as well as space. In intraframe compression we divide the picture into smaller rectangles called macroblocks. These macroblocks are compressed and tracked over time and placed into a GOP (Group of Pictures) Examples of interframe codecs include:

  • HDV (MPEG-2)
  • XDCAM (MPEG-2)
  • MPEG-4
  • H.264

MPEG-2 is a popular interframe codec. It is a very efficient in that it can squeeze a high definition video image into the same amount of space that a standard DV stream can occupy. (That's why we can record HDV onto a miniDV tape.) The other interesting thing about MPEG-2 is that it's scalable- we can make the frame dimensions varying sizes (720 x 480, 1440 x 1080 etc.). The down side is that GOPS can be difficult to edit. Deconstructing the GOPs during the edit process tasks the computers to a greater degree than intraframe codecs.

4:4:4 vs. 4:2:2 vs. 4:1:1

Today’s digital technology provides us with several ways to digitize video, mainly 4:2:2 and 4:1:1. What do they refer to?

Quite simply, they refer to the ratio of the number of luminance (Y) samples to the samples of each of the two color difference signals.

In the video signal, the most important component is the luminance as it gives us all the detail absolutely necessary in the picture. As a result, we must sample luminance at a very high rate, 13.5 Megahertz (million times per second).

Given that the luminance portion is sampled at 13.5 MHz. Let's apply the before mentioned ratios: 4:2:2 and 4:1:1. In a 4:1:1 component digital sample, the color information is sampled at 1/4 the luminance rate: 3.375MHz. In a 4:2:2 system, the color is sampled at 1/2 the rate of the luminance or 6.75MHz.

What about 4:2:0?

The 4:2:0 is used in MPEG-2 sampling. The two color difference signals are sampled on alternating lines.

What does this mean?

Quite simply, the color depth of a 4:2:2 component digital signal is twice that of a 4:1:1 signal and, from the standpoint of color bandwidth, is twice that of today’s popular component analog formats. This means better color performance, particularly in areas such as special effects, chromakeying, alpha keying (transparencies) and computer generated graphics.

Format Conversion

Editors will have to deal with a number of different media formats and need to understand the physical distinction between them.

Some of the different formats include film, standard definition and high definition versions of NTSC, PAL, 16 x 9 and 4 x 3.

NTSC (National Television Systems Committee) definition of standard definition TV broadcast, (used in North America, some of South America, Japan, etc) uses a frame rate close to 30 (actually 29.97) frames per second. There are 525 scan lines; approximately 480 of these are visible.

The ATSC (Advanced Television Systems Committee) is a group formed at the urging of the FCC to help create standards for the new high definition digital broadcast. HD TV sets with digital tuners need to be ATSC-compliant.

PAL (Phase Alternate Line) is used in most of Europe, Australia, & Asia and runs at 25 frames per second using 625 lines.

SECAM (Sequential Color and Memory) is used in France and its territories and is similar to SECAM.

If possible it’s best to edit in the media’s native format. If you have high-quality PAL footage, it’s best to try to keep it in PAL. If you have 24 fps footage, it’s best to keep it in 24 fps. That way you won’t get conversion artifacts from changing frame rates and generation losses. But while ideal, we can’t always practice this. Often we’ll get a tape from another country, or that contains another type of media that must be integrated into our existing content.

Film to Video Conversion (or 24P to 60i)

When converting film to video we use a 3:2 Pulldown (or a 2:3 Pulldown)

See

Film and 24p video runs at 24 frames per second.

Since film or 24p video runs at 24 fps and video runs about 30 fps, the two aren't directly interchangeable at least on a frame for frame basis. (To be more precise, 23.976 film frames become 29.97 video frames.) In order to transfer film to 30 fps video, the film frames must be precisely sequenced into a combination of video frames and fields.

A telecine is a piece of hardware containing a film projector sequenced with a video capture system. The telecine process is a term used to describe the process of converting film to video, also called a 3 2 pulldown. In the 3-2 pulldown each frame of film gets converted to 2 or 3 fields of video.

Note how 4 (24fps) frames are converted to 5 interlaced frames (30 fps).

3-2 Pulldown

The problem with converting film frames to fields, is that some video frames have fields from two different film frames. If you think about it you'll see that this can present all types of problems.

DTV (Digital TV broadcasting)

TV Broadcasters are supposed to broadcast totally in digital by 2007, so the analog spectrum can be reclaimed for other purposes. DTV doesn't necessarily mean high-definition.

DTV broadcasts can be either HD (High Definition) or SD (standard definition).

You can squeeze 4 SD programs in the same space used to broadcast one HD program.

Both use MPEG-2 compression.

SD vs. HD

SD works in both 4:3 and 16:9. Its video pixel dimensions include:
720 x 486, 720 x 480

HD is 16:9. Its video pixel dimensions include:
1280 x 720, 1920 x 1080

Video frame rates: 24p, 30p, 30i, 60p, or 60i.

HD has 4 discreet channels of audio.

Beside having more pixel resolution, HD can display much more information in terms of color and brightness. HD has a much larger contrast ration than SD. It's not film, but it's getting close.

Cybercollege reading: http://www.cybercollege.com/dtv_stans.htm

Metadata & Closed Captioning

Metadata (data about the data) is embedded text and numeric information about the clip or program. It can include, but is not limited to:

  • timecode
  • camera
  • exposure
  • gain
  • clip name
  • running time / duration
  • latitude/longitude
  • audio levels
  • DRM (digital rights management)

It can be stored and accessed in XMP (stands for Extensible Metadata Platform and is based on XML). While data can be embedded in XMP, some media formats do not allow for this so data is written to a separate sidecar file.

This is why it's important to keep the directory structure found on Canon DSLRs and in Sony XDCam storage devices. Key information (such as timecode) is often stored in a separate file.

Closed-captioning is one type of metadata that can be displayed on screen for the hearing-impaired. Carried in the vertical blanking interval, the FCC mandates that all stations broadcast programming with closed captioning data. If you watch closed-captionined programming, you'll see a variety of variations in readability, placement and duration.

Companies like Soft NI create stand-alone subtitler systems that let you integrate subtitles into a video stream. Adding subtitles involves proper placement on the screen. Softel-USA makes products for subtitling HD programming.

Good metadata overview by Philip Hodgetts: http://www.youtube.com/watch?v=GnPzpPvoyLA

Adobe has speech search capabilities built into SoundBooth. It analyzes the audio and transcribes it into text (speech analysis): http://www.youtube.com/watch?v=5CLqspcNWw0

Capture One photo metadata editor: http://www.youtube.com/watch?v=DbtfBAliHTw

Focus Enhancements, Firestore is capable of setting up and recording custom metadata in the field. http://www.youtube.com/watch?v=FUcAQQyz_Mg

Avid makes Metasync, a product which let's editors work with data right in the timeline. It can be used to link to other types of evidence and forensic documentation right in the timeline: http://www.youtube.com/watch?v=NGp0dc6yVWQ

 

Vocabulary (Know these terms)

  • ATSC
  • Closed Captioning
  • Codec (short for coder/decoder or compressor/decompressor)
  • DTV - Digital Television
  • HD - High Definition
  • NTSC
  • PAL
  • SECAM
  • SD - Standard Definition
  • Telecine
  • Color bars
  • EDL
  • Off-line
  • On-line
  • Pedestal (aka Setup)
  • Proc Amp
  • Setup (aka Pedestal)
  • TBC
  • Vectorscope
  • Waveform Monitor
  • Window dub

 

 

Final Test Review

Final Exam is worth 70 points! The best way to review for it is to study the class notes and the midterm (expect everything you got wrong on the midterm to be on the final). The final will be true/false, multple choice, and short answer. It will cover the following areas:

  • Shooting/Editing Techniques
    • Cybercollege editing guidelines
      • Edits work best when motivated
      • Whenever possible cut on subject movement.
      • Keep in Mind the Strengths and Limitations of the Medium (TV is a close-up medium)
      • Cut away from the scene the moment the visual statement has been made.
      • Emphasize the B-Roll
      • If in doubt, leave It out
    • Technical continuity vs production (shooting/editing) continuity
    • Continuity editing
    • Acceleration editing
    • Expanding time
    • Causality & Motivation (Must have in order to be successful)
    • Relational editing (Shots gain meaning when juxtaposed with other images. Pudovkin's experiment)
    • Thematic editing (montage)
    • Parallel editing
  • Cameras
    • Imaging devices: CCDs and CMOS
    • resolution - How do we determine horizontal resolution
    • zebra stribes - What are they good for? What would you set them for?
    • viewfinders: LCD/color vs B&W
    • Gain - What does this do?
    • Shutter speeds - what is this good for (2 good uses)
  • Lenses
    • Depth of Field - what affects this?
    • Rack focus - How can you achieve this?
    • Angle of view & focal length - How are they related?
    • f-stops - Know your f-stops & what they mean
    • ND filters - What are they good for? (2 good uses)
  • Audio
    • types of mics
    • Hz
    • cabling & connectors
    • balanced v unbalanced
    • line v mic level
    • +4 v -10
  • Graphics (Review Jim's Graphic Tips)
  • Lighting
    • types of lighting instruments
    • color temp
    • HMI
    • Lux vs footcandles
    • soft vs hard key
    • broad vs narrow lighting
  • Video signal / technology
    • ATSC, NTSC v DTV, SDTV & HDTV
    • HDTV pixel dimensions (1920 x 1080 or 1280 x 720)
    • progressive v interlace
    • Ways to transfer video digitally (cabling/connectors)
    • Ways to transfer analog video (cabling/connectors)
    • Color difference v RGB
    • timecode (difference between drop & non-drop)
    • waveform monitors & vectorscopes (What do they show?)
      • what are the important IRE levels?
    • TBC - What is this? What does it do?
    • Video architecture vs.video codecs
    • Color sampling (4:2:2 v 4:1:1)
    • 3-2 pulldown
    • Know the main principles of troubleshooting & how to go about finding problems (not guessing but deducing )

 

 

Back to Jim Krause's Summer T351 Home Page