Video Processing and Communications

Description:

For graduate level courses in digital video processing and communications, and as a reference book for practicing researchers and engineers.

With more insights and examples than other texts of its kind, Video Processing and Communications provides a good balance between theoretical concepts and practical solutions, with more rigorous formulation of certain problems such as motion estimation, sampling, basic coding theory. It is unique in its coverage of error control, scalable coding, and video streaming applications, and offers more comprehensive coverage than competitors on timely coding techniques, including issues of practical importance such as rate control, mode selection, scalable coding, and error resilience. It also contains a concise description of latest video coding standards.

 

Table of Contents:

(NOTE: Each chapter concludes with Summary, Problems, and Bibliography.

 1. Video Formation, Perception, and Representation.

Color Perception and Specification. Video Capture and Display. Analog Video Raster. Analog Color Television Systems. Digital Video.

 2. Fourier Analysis of Video Signals and Frequency Response of the Human Visual System.

Multidimensional Continuous-Space Signals and Systems. Multidimensional Discrete-Space Signals and Systems. Frequency Domain Characterization of Video Signals. Frequency Response of the Human Visual System.

 3. Video Sampling.

Basics of the Lattice Theory. Sampling over Lattices. Sampling of Video Signals. Filtering Operations in Cameras and Display Devices.

 4. Video Sampling Rate Conversion.

Conversion of Signals Sampled on Different Lattices. Sampling Rate Conversion of Video Signals.

 5. Video Modeling.

Camera Model. Illumination Model. Object Model. Scene Model. Two-Dimensional Motion Models.

 6. Two-Dimensional Motion Estimation.

Optical Flow. General Methodologies. Pixel-Based Motion Estimation. Block-Matching Algorithm. Deformable Block-Matching Algorithms. Mesh-Based Motion Estimation. Global Motion Estimation. Region-Based Motion Estimation. Multiresolution Motion Estimation. Application of Motion Estimation in Video Coding.

 7. Three-Dimensional Motion Estimation.

Feature-Based Motion Estimation. Direct Motion Estimation. Iterative Motion Estimation.

 8. Foundations of Video Coding.

Overview of Coding Systems. Basic Notions in Probability and Information Theory. Information Theory for Source Coding. Binary Encoding. Scalar Quantization. Vector Quantization.

 9. Waveform-Based Video Coding.

Block-Based Transform Coding. Predictive Coding. Video Coding Using Temporal Prediction and Transform Coding.

10. Content-Dependent Video Coding.

Two-Dimensional Shape Coding. Texture Coding for Arbitrarily Shaped Regions. Joint Shape and Texture Coding. Region-Based Video Coding. Object-Based Video Coding. Knowledge-Based Video Coding. Semantic Video Coding. Layered Coding System.

11. Scalable Video Coding.

Basic Modes of Scalability. Object-Based Scalability. Wavelet-Transform-Based Coding.

12. Stereo and Multiview Sequence Processing.

Depth Perception. Stereo Imaging Principle. Disparity Estimation. Intermediate View Synthesis. Stereo Sequence Coding.

13. Video Compression Standards.

Standardization. Video Telephony with H.261 and H.263. Standards for Visual Communication Systems. Consumer Video Communications with MPEG-1. Digital TV with MPEG-2. Coding of Audiovisual Objects with MPEG-4. Video Bit Stream Syntax. Multimedia Content Description Using MPEG-7.

14. Error Control in Video Communications.

Motivation and Overview of Approaches. Typical Video Applications and Communications Networks. Transport-Level Error Control. Error-Resilient Encoding. Decoder Error Concealment. Encoder-Decoder Interactive Error Control. Error-Resilience Tools in H.263 and MPEG-4.

15. Streaming Video over the Internet and Wireless IP Networks.

Architecture for Video Streaming Systems. Video Compression. Application-Layer QoS Control for Streaming Video. Continuous Media Distribution Services. Streaming Servers. Media Synchronization. Protocols for Streaming Video. Streaming Video over Wireless IP Networks.

Appendix A. Determination of Spatial-Temporal Gradients.

First- and Second-Order Gradient. Sobel Operator. Difference of Gaussian Filters.

Appendix B. Gradient Descent Methods.

First-Order Gradient Descent Method. Steepest Descent Method. Newton's Method. Newton-Ralphson Method. Bibliography.

Appendix C. Glossary of Acronyms.

Appendix D. Answers to Selected Problems.