CSI 390M Multimedia - Theory and Practice

Lecture: Tuesday, Thursday 15 –16:50, SI 228

Instructor: Dr. Iliya Georgiev Email: gueorgil@mscd.edu

URL: http://clem.mscd.edu/~gueorgil/ Tel. 303 556 5323 (no voice mail)

Office: Science Building 134B

Extended Description

Theoretically the course addresses all the areas related to multimedia (image processing, computer graphics, video processing, speech and audio processing, text processing and networking) to a depth that enables the students to build up a thorough understanding of the technical issues associated with this rapidly evolving subject.

Practically the course shows you how to prepare images, animation, sound, video, and interactivity files. You will learn how to incorporate these files into your sites when and where they belong. This course will help you create well-designed, user-friendly Web sites.

Students would learn how to create a multimedia player.

Shows how to use multimedia software programs such as Macromedia, Photoshop, or others.

Prerequisite

       Computer Science 2 using JAVA or C/C++ objects (CSI 2050).

Required Textbook

1.         Li Z., Drew M.Fundamentals of Multimedia. Prentice Hall, 2004, ISBN 0 13 0611872 1.

           Additional books:

  1. Multimedia Communications. Fred Halshall. Addison Wesley, 2001.

  2. Image Processing, Analysis, and Machine Vision, M. Sonka, V. Hlavac, and R. Boyle. Brooks/Cole Publishers.

   3. Computer Graphics using Open GL. Hill F.S., Prentice Hall, 2001.

Materials Needed

The students can use the materials from the textbook Web sites.

For assignments it is strongly recommended that the students save their files on a diskette (3 1/2" high density) as a backup.

Homework Assignments and Exams     

Homework assignments are intended to give you an opportunity to work with the concepts discussed in class. You MUST do the assignments in order to do well on the exams.

Late policy: home work on time - 100% credit; a week late - down to 50% credit; more than a week late - down to 0% credit (F grade). Please pay attention that the weight of F is 2, but the weight of - not presented - is 0. That means better late than never. Other late policy (if any) will be explicitly stated in the assignment.

You may not work in groups unless the assignment explicitly says that you may. You must solve problems by yourself and write your own programs, and be ready to answer questions on the algorithms and code of your programs. You may discuss the homework with your classmates and seek help from whomever you wish. All that is forbidden is blatant copying , which will be enforced. The only exception is that if two students are team partners on an assignment, then they may copy each other’s code on that assignment.

Exams will further explore the concepts learned in class and that you have explored while working on the assignments.

Attendance

 You are expected to attend class and to arrive on time. Class attendance is important since some material will be covered that is not in the textbook. Should you miss class, you are responsible for completing any missed work before the next class. This is important since class exercises will often build on each other.

The college policy on Class Attendance on Religious Holidays is posted on the Information board outside the Math and CS department office (SI141). It is the student’s responsibility to understand and abide by the policy.

Grading Policy (tentative)

You will be given a series of problem solving, programming assignments and midterm exam(s).

The various items will be weighted as follows in determining your grade:
Homework 30%, Midterm1 20%, Midterm2 20%, Final 30%.
This will give you a total grade expressed as a percentage (0-100). Grades will be assigned according to the following rule:

A 90% or above
B 80% to 90%
C 70% to 80%
D 60% to 70%
F below 60%

Semester grade will be calculated on the base of the following grade weights: A →6, B → 5, C→4, D→ 3, F → 2, not presented (home work, midterm) → 0.

Course Outline (could be changed)

Remark: All lectures notes and assignments will be published in the Web page of the course - follow the hyperlink in http://clem.mscd.edu/~gueorgil/.

Week

Topics

Readings

Presentation

 

 

 

 

1

Introduction → theoretical foundations, multimedia networks, multimedia applications.

Notes.

H chapter 1

Multimedia_Introduction.ppt

2

Signals. Quantizing, sampling.

Notes.

H chapter 2

 Multimedia 2_Signals.ppt

 Multimedia 3_Sampling.ppt

3

Signals. Quantizing, sampling.

Compression Principles:

-          run length encoding;

-          entropy encoding;

-          transformation encoding.

Text Compression:

-          entropy Huffman encoding;

-      dictionary encoding;

 

      -       Limpel-Ziv-Welsh encoding.

-           

 

Notes.

H chapter 3.

 Multimedia 4_Text  Compression.ppt

4

Visual Information Processing:

-          procedural model;

-          from image to abstract model: Image processing, Image Understanding, Computer Vision;

-          from abstract model to Image: Geometric Modeling, Computer Graphics.

Midterm Exam 1 .

Notes.

 Multimedia 5 - Visual Information.ppt

 

5

Image Compression:

-          image presentation, color signals;

-          image compression principles;

-          transformation encoding (Discrete Cosine Transformation, Wavelet encoding);

-          two approaches to image compression;

-          GIF and PNG;

-          JPEG.

Notes.

H chapter 3.

 Multimedia 6 - Image Compression.ppt

Multimedia 6_1 - JPEG Compression.ppt

6

Audio Compression:

-          Differential Pulse Code Modulation;

-          Delta Modulation;

-          Predictive Encoding, Linear Predictive Code;

-          GSM encoding

-          Perceptual encoding;

-          MPEG Audio;

-          MIDI encoding.

Notes. H Ch.3

 Multimedia 7 - Audio Compression.ppt

7

Video Compression:

-          principle of video encoding.

Notes. H Ch.4

 Multimedia 8- Video Compression.ppt

8

Video Compression:

-          motion estimation and compensation;

-       MPEG.

Introduction to Image Processing:

- basic functions.

Lecture Notes

 

  Multimedia 9 - Image Processing.ppt

9

Introduction to Image Processing:

-          contouring;

-          pattern detection and recognition;

-          scene analysis and computer vision.

Midterm Exam 2 .

Lecture Notes

 

10

Introduction to Computer Graphics:

-          procedural model;

-          graphical primitives.

Lecture Notes

 Multimedia 10_1 - Computer Graphics.ppt

11

Introduction to Computer Graphics:

 -window and clipping transformations;

- coordinate transformations;

- rendering pipeline.

Lecture Notes

 Multimedia 10_2 - Computer Graphics.ppt

12

Introduction to Geometric Modeling:

-          wire-frame modeling;

-          boundary modeling;

-          Constructive Solid Geometry;

-          Sweeping modeling;

-          Surface Modeling.

Introduction to Computer Animation:

- basic techniques.

Lecture Notes

 

 Multimedia 11 - Geometric Modeling.ppt

 

 

 

 

 

 

 

Multimedia 12 - Computer Animation.ppt

13

Multimedia Networks ]

 

H Ch. 5,6,. Notes

Multimedia 13 - Multimedia Networks.ppt 

 

14

Virtual Reality

Notes

Multimedia 14 - Virtual Reality.ppt  

15

Practical Issues

 

     Multimedia 15 -  Practical Issues.ppt       

*** Some Useful Links Related to Multimedia Systems:   Links

 

         *** Overview of some Multimedia Software Tools:

               Multimedia Software Tools.html

16

Final Exam

 

 

Students with disabilities

The American with Disabilities of 1990 and other Federal laws require providing reasonable accommodation to any individual who advises of a physical, psychological, or learning disability. Students desiring a reasonable accommodation under the ADA must contact the course instructor to discuss your needs and how to register for support services.

** Reading Assignment (week 1)  from Tanenbaum: 1.1, 2.1.1, 2.1.2, 2.1.5, 2.2.1, 2.2.2, 2.2.3, 2.2.5, 2.3.1, 2.3.2, 2.3.7, 2.4.2, 2.4.3, 2.4.4, 2.4.5.

1. 

1.** Homework Assignment Arithmetic Basics: HW1_Arithmetic.doc

1.(Related Reading Assignment: Tanenbaum chapter 2.2.4, Apex A, Apex B, Lecture Presentations)

1. 

1.**** Midterm Exam 1 : Binary Codes and Arithmetic:

1.   class 50385  September 19 (Wednesday);

1.class 50386  September 18 (Tuesday).

1.(Related Reading Assignment: Tanenbaum chapter 2.2.4, Apex A, Apex B, Lecture Presentations)

1.2. ** Homework Assignment Computer Logic: HW2_Logic

1.2. * Homework Assignment Digital Logic: HW2_Digital Logic

1.(Related Reading Assignment: Tanenbaum chapter 3, Lecture Slides and Notes)*** Midterm Exam 2: Computer Logic

1.**** Midterm Exam 2 : Digital Logic

1.   class 50385  October 8 (Monday);

1.class 50386  October 9 (Tuesday).

1.(Related Reading Assignment: Tanenbaum chapter 3, Lecture Slides and Notes)

1. 

1. 

1.3. **Assembly Language Assignment 1:

1.Choose a platform for Intel Assembly Programming (MASM, TASM,);

1.Self educate you to compile, link and debug (use the textbook Kip Irvine, Assembly Language for Intel-based Computers).

1. 

1.** Homework Assignment Assembly Language: HW3-Assembler

1.(Related Reading Assignment: Irvine chapter 1,2,3, Assembler Editor help)

1. 

1.**** Project Assembly Programming : Project-Assembler

1. 

1.**** Final Exam Conspectus  Final Conspectus

1. 

1.**** Final Exam - 50385 (MW)  December 12, 2001, 14:00  16:00

1.50386 (TTr)  December 13, 2001, 17:00  19:00

1. 

1. 

Assignments (see the course page on Metroconnect)

Midterm Exam 1 – Sampling and Quantization

Midterm Exam 2 – Compression Principles of text, images, sounds and voice

Project – MIDI sequences interpreter

Final Exam