Multimedia Computing

Humans are the best functioning example of multimedia communication and computing - that is, we understand information and experiences through the unified perspective offered by our five senses. This innovative textbook presents emerging techniques in multimedia computing from an experiential perspective in which each medium - audio, images, text, and so on - is a strong component of the complete, integrated exchange of information or experience. The authors' goal is to present current techniques in computing and communication that will lead to the development of a unified and holistic approach to computing using heterogeneous data sources. Gerald Friedland and Ramesh Jain introduce the fundamentals of multimedia computing, describing the properties of perceptually encoded information, presenting common algorithms and concepts for handling it, and outlining the typical requirements for emerging applications that use multifarious information sources. Designed for advanced undergraduate and beginning graduate courses, the book will also serve as an introduction for engineers and researchers interested in understanding the elements of multimedia and their role in building specific applications.

1. Introduction; 2. Multimedia: a definition; 3. Elements of multimedia computing; 4. Introduction to sensors; 5. Sound; 6. Light; 7. Multimedia documents; 8. Multimodal integration and synchronization; 9. Multimedia systems; 10. The human factor; 11. Fundamentals of compression; 12. Lossy compression; 13. Advanced perceptual compression; 14. Speech compression; 15. Multimedia information retrieval; 16. Signal processing primer; 17. Multimedia content analysis; 18. Content analysis systems; 19. Content and context; 20. Future topics.

Gerald Friedland is the Director of Audio and Multimedia Research at the International Computer Science Institute, a private lab affiliated with the University of California, Berkeley, where he is currently leading a group of multimedia researchers.
Ramesh Jain is a Donald Bren Professor in Information and Computer Sciences at the University of California, Irvine, where he is doing research in EventWeb and Experiential Computing for developing and building social life networks.