Telecommunications | Special Projects in Telecommunications
T540 | 23165 | Herber, N.

T540 Sounds, Images, and Interactivity

Lecture Class Number: 23165

Instructor: Norbert Herber

Course Description:
It is essential for interactive designers and developers to have
several channels of communication with their audience.
Traditionally, the visual channel has been given the most attention.
The recipe for immersion has relied on graphical wizardry in favor
of creating an experience that is visually compelling and engaging.
What is missing is this same kind of attention and focus on the
audio components of an interactive experience. In the whole of
interactive media this channel has been largely neglected. The audio
elements and overall aural design of the interactive experience have
not been fully considered.

Only through the thoughtful planning of interactive sound structures
will there be the kind of audio and graphic synergy that enables the
immersive experience to reach its full potential. This course aims
to explore the concepts and techniques that bind the image + sound
relationship in an interactive environment.

Course Objectives:
An understanding of audio and its relationship with images is
essential to the success of an interactive production. The course
will approach the material from both theoretical and practical
perspectives. To discover the intricacies of this relationship,
students will study the following topics:
+ audio-only media: radio theater and other spoken word productions
+ film music: role of music in cinema and film music techniques
+ music for television: how does television music direct the
narrative flow
+ audio in computer games (classic and contemporary)
+ audio in CD-ROM based media
+ audio on the Internet

Careful study and consideration must also go with practical
application for a full understanding of the interactive audio
development process. Students will have the opportunity to work with
contemporary digital audio and media authoring tools to practice
implementing the techniques they study and develop. The experience
of creating interactive sound schemes will bring their studies full-
circle from analysis through implementation.

This course assumes a fundamental understanding of MIDI, digital
audio applications, Flash/ActionScript, Director/Lingo, and related
multimedia production tools. Permission of instructor required for