MUS-N 568 / INFO-I 547
AUDIO MUSIC INFORMATION PROCESSING
11:15A-12:30P   TR (ROOM TBA)
Prof. C. Raphael

This course deals with various music analysis and processing
problems that use sampled audio as the primary data representation.
We discuss, but do not emphasize, digital signal processing
including filtering and its relationship to Fourier techniques.
We will focus on applications including score following (online
and offline), automatic music transcription and annotation
from audio, musical accompaniment systems, as well as some
useful audio effects.  The class is open to all graduate students,
but students should be prepared for some mathematics, computer
science and statistics.


Digital Audio
Digital Audio    Basics
Fourier and Z-transforms
Spectrograms and STFT

Short-time Audio Models and Effects
Linear Predictive Coding
Source-Filter Model
Time-Stretching
Special Effects

Score Following
Off-line Following
On-line Following
Simultaneous Estimation of Tempo Process

Recognition of Musical Audio
Pitch and Chord Recognition
Harmonic Content from Audio
Specmurt approach
Monophonic Instrumental and Singing Recognition
Polyphonic Recognition

Musical Accompaniment Systems
Traditional Music
Making New Music Possible

Instrument Analysis from Audio
Instrument Classification
Tracking Musical Parameters