1. 1 Basic concepts of multimedia
1. 1. 1 the concept of media
1. 1.2 multimedia and multimedia technology
1.2 fundamentals of audio information processing
1.2. 1 Basic characteristics of sound
1.2.2 Subjective feelings of sound
1.2.3 Digitization of Audio Signal
1.3 fundamentals of image information processing
1.3. 1 color and three elements of color
1.3.2 trichromatic principle
1.3.3 Several typical color space models and their transformation relationships
1.3.4 Digitization of image signal
Digitization of 1.4 video signal
The application of 1.5 MATLAB in image processing
Introduction to 1.5. 1 MATLAB
Basic operation of image file in MATLAB+0.5.2
1.5.3 MATLAB programming example
1.6 summary
utilize
Chapter 2 Image Enhancement
2. 1 Introduction
2.2 Gray transformation of images
2.2. 1 gray linear transformation
2.2.2 Non-linear transformation of gray scale
Histogram correction
Histogram specification
2.3 image smoothing
2.3. 1 template operation and convolution operation
2.3.2 Neighborhood average method
median filtering
2.3.4 Frequency domain low-pass filtering
2.4 image sharpening
2.4. 1 gradient operation (operator)
Sobel operator
Laplace operator
2.4.4 Qualcomm filtering in frequency domain
2.5 homomorphic filtering of images
2.6 color enhancement
2.6. 1 Pseudo-color enhancement
Wrong color enhancement
2.7 MATLAB programming examples
2.8 Summary
utilize
Chapter III Morphological Image Processing
3. 1 Introduction
3. 1. 1 A brief history and basic ideas of mathematical morphology
3. 1.2 Basis of set theory
3. 1.3 Several Basic Concepts in Mathematical Morphology
3.2 Basic operations of binary morphology
3.2. 1 corrosion
expand
3.2.3 Duality of corrosion operation and expansion operation
Open operation
Closed operation
3.3 Morphological processing of binary images
3.3. 1 edge extraction
Area filling
Skeleton extraction
improve
Roughening
Morphological filtering
3.4 the basic operation of gray morphology
3.4. 1 gray scale corrosion
Gray scale expansion
3.4.3 Gray Level Open Operation and Closed Operation
3.5 Morphological processing of gray image
3.5. 1 morphological gradient
Morphological smoothing filtering
3.5.3 Top hat conversion
3.6 MATLAB programming examples
3.6. Basic mathematical functions of morphology in1MATLAB
MATLAB programming example
3.7 Summary
utilize
Chapter 4 Image Segmentation
4. 1 Concept and classification of image segmentation
4. 1. 1 the concept of image segmentation
4. 1.2 Basis and method classification of image segmentation
4.2 Image Segmentation Based on Gray Threshold
4.2. 1 threshold segmentation principle
4.2.2 Global Threshold Segmentation Method
4.2.3 Local threshold segmentation method
4.3 Image Segmentation Based on Edge Detection
4.3. 1 Basic principles and steps of edge detection
Gradient operator
4.3.3 Laplacian Operator and Logarithmic Operator
Canny operator
Edge tracking
4.4 Region-based image segmentation
4.4. 1 regional growth method
4.4.2 Method of regional division and merger
4.5 MATLAB programming examples
4.6 Summary
utilize
Chapter 5: The principle of digital image and video compression coding.
5. 1 Overview of digital image and video compression coding
5. 1. 1 Necessity and possibility of digital image and video compression
5. 1.2 Main methods and classification of digital image and video compression coding
5.2 Distortionless coding
5.2. 1 Run-length coding
huffman encoding
arithmetic coding
5.3 predictive coding
5.3. 1 Statistical characteristics of image difference signal
5.3.2 Intra-frame predictive coding
5.3.3 Inter-frame predictive coding
5.4 Conversion coding
5.4. 1 Statistical characteristics of frequency domain images
5.4.2 Basic principles of transcoding
5.4.3 Selection of Orthogonal Transform Basis
5.4.4 DCT image coding
5.5 MATLAB programming example
5.6 Summary
utilize
Chapter VI Digital Image and Video Compression Coding Standards
6. 1 Still Image Coding Standard
6. Overview of1.1JPEG standard
6. 1.2 JPEG basic coding system
6. 1.3 Progressive coding based on DCT
6. 1.4 hierarchical coding
6. Overview of1.5 JPEG 2000 standard
6.1.6 Basic Framework of JPEG 2000 Standard
6. Main features of1.7 JPEG 2000
6.2 Standardization process of digital video coding
6.3 MPEG- 1/MPEG-2 video coding standard
6.3. 1 I frame, p frame and b frame
6.3.2 Hierarchical structure of video stream
6.3.3 MPEG- 1/MPEG-2 video coding and decoding principle
6. 3. 4 MPEG-2 Function Extension
6.4 MPEG-4 video coding standard
6.4. 1 Overview
6.4.2 MPEG-4 video coding functions and characteristics
6.4.3 Video coding based on MPEG-4 content
6.5 H.263 video coding standard
6.5. 1 video source image format
6.5.2 H.263 video coding and decoding principle
6.5.3 H.263 optional mode
Optional mode of 6.5.4 H.263+
Optional mode of 6.5.5 H.263++
6.6 H.264/AVC video coding standard
6.6. 1 H.264/AVC encoder hierarchy
6.6.2 Predictive coding
6.6.3 Integer Transformation and Quantization
6.6.4 Adaptive Entropy Coding Based on Context
6.7 AVS video coding standard
6.7. 1 AVS-P2
6.7.2 Comparison between AVS-P2 and H.264
6.8 summary
utilize
Chapter VII Digital Audio Coding Technology and Standards
7. 1 Overview of Digital Audio Compression Coding
7. 1. 1 digital audio compression coding mechanism
7. 1.2 Performance index of audio codec
7. 1.3 classification of digital audio coding technology
7. 1.4 Overview of Digital Audio Coding Standards
7.2 Common Digital Audio Coding Technology
7.2. 1 linear predictive coding
Vector quantization
CELP coding
7.2.4 subband coding
7.3 MPEG- 1 Audio Coding Standard
7.3. Features of1MPEG-1Audio Coding Algorithm
7.3.2 Basic Principles of MPEG-1Audio Coding
7.4 MPEG-2 AAC Audio Coding Standard
7.4. 1 Overview
7.4.2 MPEG-2 AAC coding algorithm and characteristics
7. 4. 3 MPEG-2 AAC level
7.5 Audio coding standard formulated by China.
7.5. 1 AVS audio stereo coding standard
7.5.2 DRA multi-channel digital audio coding and decoding standard
7.6 Summary
utilize
Chapter 8 Digital Media File Format
8. 1 Resource Exchange File Format (RIFF)
8.2 Digital image file format
8.2. 1 bitmap and palette concepts
8.2.2 General structure of image file
8.2.3 BMP file format
GIF file format
8.2.5 JPEG file exchange format
Other image file formats
8.3 Common animation file formats
8.3. 1 FLI/FLC file format
8.3.2 SWF file format
8.4 Digital video file format
8.4. 1 AVI file format
8.4.2 MPEG/MPG/DAT/DivX/XviD
8.5 Digital Audio File Format
8.5. 1 WAV file format
8.5.2 MPEG audio (MP 1/MP2/MP3/AAC) file format.
8.5.3 Other audio file formats
8.6 streaming media file format
8.6. 1 Real Media File Format
ASF file format
8.6.3 QuickTime file format
FLV file format
8.6.5 Other streaming media file formats
8.7 Summary
utilize
Chapter 9 Digital Watermarking Technology
9. 1 Overview of digital watermarking
9. 1. 1 Background and application of digital watermarking technology
9. 1.2 Basic characteristics of digital watermarking
9. 1.3 Composition of Digital Watermarking System
9. 1.4 Classification of digital watermarking
9.2 Digital Image Watermarking Algorithm
9.2. 1 lowest position method
Method based on DCT domain
9.3 Digital Video Watermark Embedding and Extracting Scheme
9.3. 1 Watermarking Scheme Based on Uncompressed Original Video
9.3.2 Watermarking Scheme Based on Video Coding
9.3.3 Watermarking Scheme Based on Compressed Video Stream
9.4 Digital Audio Watermarking Algorithm
9.4. 1 lowest position method
9.4.2 echo hiding method
9.4.3 Phase coding method
9.4.4 Transform domain method
9.4.5 Based on compressed audio method
9.5 MATLAB programming example
9.6 Summary
utilize
10 Content-based Multimedia Information Retrieval
10. 1 Overview of content-based retrieval technology
10. 1. 1 multimedia information content
10. 1.2 content processing technology
10. 1.3 query method based on content retrieval
10. 1.4 overall structure of content-based retrieval system
10. 1.5 content-based retrieval process
10. 1.6 Content-based retrieval function
10.2 content-based image retrieval
10.2. 1 Overview of Content-based Image Retrieval
10.2.2 image color feature extraction and representation
10.2.3 image texture feature extraction and representation
10.2.4 image shape feature extraction and representation
10.2.5 image spatial relationship feature extraction and representation
10.2.6 image similarity measure
10.2.7 Relevant feedback mechanism of image retrieval
10.3 content-based video retrieval
Overview of Content-based Video Retrieval
10.3.2 Structuring of video content
10.3.3 content-based video retrieval workflow
10.3.4 structure of content-based video retrieval system
10.3.5 Basic concept of lens switching
10.3.6 shot boundary detection
10.3.7 key frame extraction
10.3.8 shot clustering (scene detection)
10.4 content-based audio retrieval
10.4. 1 Feature representation of audio content
10.4.2 Overview of Content-based Audio Retrieval
10.4.3 Content-based voice retrieval
10.4.4 Content-based music retrieval
10.5 summary
utilize
refer to