Multimedia Computing
This course covers the basic concepts of Multimedia system including introduction, Sound / Audio System, Images and Graphics, Video and Animation, Data Compression, User Interfaces, Abstractions for programming and Multimedia Application
This course covers three main objectives on multimedia system these are devices, systems and applications
Course Contents
Introduction To multimedia system, history and applications, Global structure of Multimedia: Device, system, application, and cross domains, Basic applications of multimedia system in all sectors, Media types: Perception, representation, presentation, storage, transmission, and information exchange, Representation values, spaces, and dimensions, Multimedia system properties: Combination of media, independence, computer support integration, Characteristics: Computer controlled, integrated, digital representation, interactive interface, Challenges: Synchronization, Sequencing, Distributed Network, Inter-media Scheduling, Components: Capture devices, Storage Devices, Communication Networks, Computer Systems, Display Devices
Concepts of sound: Frequency, amplitude, Computer representation, sampling rate, quantization, hardware, Music and speech: Basic MIDI concepts, devices, messages, MIDI and SMPTE timing standards, MIDI software, Speech Generation: Reproduced Speech output, Time/frequency dependent sound concatenation, Speech Analysis: Research area, speech recognition, Speech Transmission: Signal form coding, source coding in parametrized systems, recognition and synthesis systems
Digital Image Representation: Image format, storage image format, Introduction about different Image and graphics Format, Image Synthesis, analysis and Transmission, Computer Image processing, dynamics in graphics, interactive graphics systems framework, Graphics input/output hardware, dithering, image analysis, Image recognition steps, Image transmission
Video signal representation: Visual representation, Transmission, digitalization, Introduction to Computer video format, Computer-Based animation: Input process, composition stage, inbetween process, Changing colors, Animation Languages: Linear list notations, General purpose language, Graphical Languages, Methods of controlling Animation: Full explicit control, procedural control, constraint based systems, tracking live action, kinematics and dynamics, Display and Transmission of Animation
Storage Space and Coding Requirements, Source, Entropy and Hybrid Coding: Huffman Encoding, Arithmetic encoding (introduction), Run length encoding, Lossy Sequential DCT-based Mode: Steps and process, Expanded Lossy DCT-based Mode: Steps and process, JPEG and MPEG compression processes
Basic Design Issues: Architectural issues, presentation functions, effective human computer interaction, Video and Audio at the User Interface: System vs application software, User-friendliness: Easy to learn instruction, presentation, Dialogue boxes, additional design criteria
Abstractions Levels of multimedia systems programming, Introduction to Libraries and Toolkits, System Software: Data as Time capsules and Streams, Higher Programming Languages: Media as types, files, processes; Interprocess communication, Object-oriented approaches: Classes, Inheritance, Polymorphism, application-specific/generic metaphors
Media preparation and composition: Scanners, recognition, tracking, and motion based devices, Media integration and communication: Multimedia/Hypermedia editors, authoring tools, tele-services, Media Entertainment: Virtual Reality, Interactive video/audio, Games, Applications: Telemedicine, E-learning, Digital video editing and production, Video conferencing and Video-on-demand
Laboratory Works
After completing this course, students should have practical knowledge of different components of multimedia system, multimedia tools and applications. The laboratory work includes: Macromedia FreeHand, Macromedia Flash, Swish Max, Macromedia Director, Morphing techniques, Audio and Video editing software, Data compression.