COURSE TITLE: EECS 421 Multimedia Signal Processing

CATALOG DESCRIPTION: Fundamentals of processing multimedia signals: text, graphics, speech, audio, image, video; standards for multimedia coding, processing and compression. Related products and services will be discussed.

REQUIRED TEXTS: Khalid Sayood, Introduction to Data Compression , Morgan Kaufmann, 2 nd edition (2000)

COURSE DIRECTOR: Aggelos Katsaggelos

COURSE GOALS: To provide an introduction to the fundamental principles and techniques in multimedia signal processing and compression, an overview of the current multimedia standards and technologies, and a brief description of future technologies.

PREREQUISITES BY COURSES: EECS 359 or equivalent, or permission of the instructor

DETAILED COURSE TOPICS:

Digital Processing Basics

Multimedia Processing and Communications

Compression and Networking as Cornerstones

Information Theory Basics

Lossless Source Coding

Huffman/arithmetic Codes, LZW

Text/graphics Compression

Fax Standards (Group 3, Group 4, JBIG)

Quantization (scalar/vector)

Waveform, Transform, Model-based Coding

Performance Criteria, Perception

Human Visual System Models

Still Image Compression

JPEG, JPEG2000

Wavelet/Subband/Fractal

Perceptually-based Coders

2 nd Generation Image Coding

Speech Production

Speech Compression

LPC, CELP, MELP

Applications

Audio Compression

The G.72X Standars

Fundamentals of Perceptual Coders

MPEG-1/2, Dolby AC-2 and AC-3

Compression of Stereo and Surround Sound

Video Compression Basics

Motion Estimation and Compensation

Rate-Distortion based Optimal Encoding

Overview of Multimedia Communication Standards H.323 and H.324

Video Compression Standards H.261, H.263

Video Compression Standards MPEG-1, MPEG-2, and HDTV

Applications/Consumer Electronic Products

“Modern” Coding Techniques

MPEG-4

Coding of Audio Objects (natural, synthetic)

Coding of Visual Objects (boundary encoding)

Sprites, Facial Animation

MPEG-7

Applications

Multimedia Transmission

Error Resilience and Concealment

Multimedia over IP

Multimodal Signal Processing

Speech-assisted Video Coding

Multimodal Speech Recognition

COMPUTER USAGE: None.

PROJECT: A bibliographical search or computer type project is required. The purpose of this project is to enhance the understanding of a topic covered in class or to investigate a topic not covered in class. A final report and a presentation are required.

GRADES:

Homework Assignments – 60%

Project – 40%

COURSE OBJECTIVES: When a student completes this course, s/he should be able to:

•  Understand the fundamentals behind multimedia signal processing.

•  Understand the fundamentals behind multimedia compression.

•  Understand the basic principles behind existing multimedia compression and communication standards.

•  Understand future multimedia technologies.

•  Apply the acquired knowledge to specific multimedia related problems and projects at work.

•  Take advanced courses in this area.