18.11.2014 Views

视音频压缩及处理

视音频压缩及处理

视音频压缩及处理

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Email: tian@dr.com<br />

http://www.digiark.com/tian


H.261<br />

<br />

MPEG<br />

<br />

MPEG-2<br />

<br />

MPEG-4<br />

<br />

MPEG-7


H.261<br />

1.1 H.261<br />

1.2 H.261<br />

1.3 H.261<br />

1.4 H.261<br />

1.5 H.261<br />

1.6 H.26


1.1 H.261<br />

H.261 P64 ITU-T<br />

CCITT<br />

<br />

ISDN64kbps<br />

6 4 kbps <br />

p64kbpsH261<br />

<br />

QCIFCIF


1.2 H.261


PCM<br />

<br />

PCM<br />

641920kbs N-<br />

ISDNPCM<br />

<br />

PAL<br />

625 25<br />

<br />

6252 NTSC<br />

525 30


1.3 H.261<br />

625<br />

PAL 525NTSC<br />

<br />

CIF(Common Intermediate Format)<br />

<br />

CIFQCIF<br />

<br />

CIF<br />

352288<br />

172144


43<br />

<br />

<br />

<br />

<br />

<br />

<br />

ISDN P1<br />

2<br />

128kbpsCIF<br />

<br />

QCIF<br />

176*144<br />

88*72<br />

<br />

QCIF


CCIR601 ISO/MPEG-1 CCITT H.261<br />

PAL NTSC SIF CIF QCIF<br />

25 30 25 30 29.97<br />

Y 576<br />

Cr 288<br />

Cb 288<br />

Y 720<br />

Cr 360<br />

Cb 360<br />

480<br />

240<br />

240<br />

288<br />

144<br />

144<br />

360<br />

180<br />

180<br />

240<br />

120<br />

120<br />

288<br />

144<br />

144<br />

352<br />

176<br />

176<br />

144<br />

72<br />

72<br />

176<br />

88<br />

88<br />

1


1.4 H.261<br />


CIFQCIF<br />

<br />

ISDN<br />

<br />

DCT<br />

<br />

<br />

4<br />

DCT


BCH<br />

<br />

<br />

<br />

• <br />

<br />

p*64<br />

kbps(p=1-30), 64kbps1.92Mbps


• <br />

P=12 QCIF<br />

<br />

64kbps<br />

<br />

40kbps 16kbps<br />

128kbps<br />

16-64kbps<br />

<br />

64-112kbps<br />

10-15/<br />

250ms<br />

<br />

<br />

DCIF<br />

<br />

P6, CIF<br />

30


• <br />

<br />

BCH


1.5 H.261


8*8<br />

<br />

<br />

16*16 MB<br />

<br />

30000/1001=29.97


8*8DCT DCT<br />

<br />

<br />

<br />

<br />

<br />

DCT


DCT<br />

<br />

<br />

DCT<br />

<br />

<br />

DCT


DCT<br />

VLC<br />

<br />

<br />

DCT<br />

<br />

31


ZigZag<br />

<br />

EOB<br />

<br />

(Run)<br />

(Level)<br />

<br />

20<br />

6 (Escape)6<br />

(Run) 8 (Level)


0-255


• <br />

<br />

<br />

(Picture)<br />

(GOBGroup of blocks) (MB<br />

Macroblock) (Block)<br />

<br />

CIF<br />

12GOB GOB 33MB<br />

MB 4<br />

1Cb Cr<br />

B 8*8<br />

GOB MB


1



• <br />

<br />

<br />

<br />

<br />

BCH


1.6 H.26<br />

H.261


ITU-T SG151990 "ATM<br />

<br />

" B-<br />

ISDN ATM<br />

199311 MPEG<br />

H.262<br />

<br />

<br />

3C


DCT<br />

<br />

<br />

<br />

<br />

" "<br />

<br />

<br />

"


DCT<br />

<br />

<br />

<br />

<br />

" "<br />

<br />

<br />

"


MPEG<br />

<br />

2.1 MPEG-1<br />

2.2 MPEG-1<br />

2.3 MPEG-1


MPEG<br />

( Moving Picture Expert Group)<br />

<br />

MPEG 10<br />

<br />

<br />

MPEG<br />

MPEG MPEG<br />

MPEG<br />

<br />

<br />

501


ISO<br />

ITU<br />

<br />

H.261<br />

JPEG<br />

JBIG <br />

MPEG-1<br />

MPEG-2MPEG-3MPEG-4MPEG-7


2.1 MPEG-1<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

MPEG-1<br />

MPEG-1<br />

MPEG-1<br />

MPEG-1<br />

MPEG<br />

MPEG


MPEG-1<br />

MPEG MPEG MPEG<br />

MPEG-1<br />

<br />

1.5Mbps<br />

1.2Mbps<br />

0.3Mbps<br />

MPEG<br />

<br />

MPEG


MPEG-1 SIF<br />

VHS CD<br />

<br />

MPEG-1<br />

1/100-1200 1<br />

6.5<br />

MPEG1<br />

<br />

<br />

<br />

<br />

MPEG-1 SIF<br />

2530/<br />

1.5Mbps<br />

1.2Mbps 0.3Mbps


VHS<br />

CD MPEG-1<br />

<br />

MPEG-1<br />

<br />

MPEG<br />

MPEG-1<br />

IDCT<br />

MPEG-1


MPEG-1<br />

MPEG<br />

<br />

<br />

1. <br />

VCD<br />

0K<br />

2.


3. <br />

<br />

<br />

<br />

<br />

4. <br />

<br />

5.


JPEG<br />

H261


MPEG-1<br />

1. <br />

<br />

VHS<br />

<br />

CD-ROM<br />

2. <br />

<br />

3. <br />

1-15Mbps 1.2Mbps<br />

4. ISDN LAN<br />

5.


MPEG-1<br />

1. MPEG-1<br />

<br />

<br />

2. MPEG-1<br />

<br />

<br />

<br />

3. <br />

4.


MPEG-1<br />

MPEG-1 H.<br />

<br />

<br />

<br />

2<br />

MPEG


MPEG<br />

<br />

<br />

SIF<br />

H.261 MPEG<br />

16*16<br />

8*8 DCT<br />

<br />

<br />

“ ”slice


MPEG


MPEG-1<br />

<br />

<br />

MPEG-1<br />

Intra pictures predicted <br />

pictures (bi-directional picture)<br />

1. I<br />

JPEG


2. P<br />

IP<br />

<br />

P<br />

<br />

B<br />

P P<br />

<br />

3. <br />

<br />

B<br />

<br />

<br />

<br />

MPEG


IBBPBBPBBPBBPBBIBBPBBPBBPBBPBB<br />

<br />

<br />

MPEG-1<br />

H.261<br />

MPEG-1


1. <br />

I<br />

<br />

<br />

<br />

<br />

I<br />

<br />

I<br />

2. <br />

B<br />

IP<br />

B


B<br />

<br />

3. <br />

<br />

<br />

<br />

<br />

B<br />

B


P B<br />

<br />

I


MPEG<br />

MPEG<br />

<br />

<br />

MPEG<br />

<br />

(interpel)<br />

<br />

<br />

<br />

(<br />

) <br />

<br />

( )


MPEG<br />

<br />

(DCT)<br />

88


( )<br />

DPCM<br />

MPEG<br />

<br />

<br />

( DPCM/DCT ) <br />

<br />

<br />

<br />

MPEG-1


( )<br />

DPCM<br />

MPEG<br />

<br />

<br />

( DPCM/DCT ) <br />

<br />

<br />

<br />

MPEG-1


MPEG<br />

YUV (<br />

)<br />

<br />

Y:U:V ( MPEG-2 4:1:1<br />

4:2:2


DPCM<br />

MPEG-l MPEG-2<br />

<br />

<br />

<br />

<br />

(<br />

<br />

)


(MPEG-lMPEG-2<br />

<br />

1616 )<br />

<br />

MPEG


(<br />

<br />

)


(NN ) 88<br />

<br />

(DCT)<br />

<br />

DCT<br />

<br />

DCT<br />

<br />

VLSI


DCT<br />

<br />

DCT (<br />

DCT )<br />

<br />

<br />

DCT


DCT<br />

DPCM<br />

DCT<br />

DCT<br />

MPEG


( )<br />

( ) <br />

MPEG<br />

<br />

DPCM/DCT


MPEG-1<br />

MPEG-l(MPEG-2)<br />

<br />

<br />

MPEG-1 (I<br />

)<br />

<br />

(P )<br />

<br />

" " 4<br />

(Y1Y2Y3Y4)


(UV)<br />

<br />

YUV<br />

<br />

411 <br />

<br />

P<br />

<br />

" "(MB)<br />

<br />

4 (Y 3<br />

Y2Y3Y4)<br />

(UV)<br />

<br />

88<br />

1(I ) (INTRA)


DCT <br />

88<br />

DCT 64DCT<br />

<br />

(Q)<br />

DCT<br />

(DC )<br />

<br />

(AC )<br />

<br />

DC<br />

<br />

DC DC<br />

<br />

(VLC)


P I<br />

N-l<br />

<br />

(MC)-<br />

N N-1 <br />

<br />

<br />

88DCT<br />

<br />

88 DCT<br />

(Q)<br />

(VLC)


(SZ)<br />

<br />

<br />

N<br />

<br />

(VB) (VLD) <br />

(QDCT-1 )


MPEG<br />

MPEG-1<br />

"<br />

"<br />

MPEG<br />

MPEG<br />

MPEG<br />

<br />

2001<br />

99%<br />

MPEG


MPEG<br />

<br />

<br />

<br />

MPEG<br />

<br />

MPEG


2.2 MPEG-1<br />

<br />

<br />

<br />

MPEG<br />

MPEG-1<br />

MPEG-1


MPEG<br />

<br />

<br />

32kHz44.1kHz48kHz<br />

<br />

CDDAT<br />

PCM<br />

mp3


MPEG<br />

<br />

1991<br />

MPEG<br />

<br />

<br />

<br />

MPEG


MPEG <br />

/<br />

<br />

<br />

MPEG<br />

<br />

MPEG<br />

<br />

<br />

MPEG


1:12 <br />

, 30M CD <br />

, MP3 2M . JPG<br />

<br />

, . MP3 <br />

<br />

, , <br />

MP3


MPEG<br />

MPEG<br />

<br />

<br />

<br />

96kbps<br />

CD<br />

<br />

MPEG-1


MPEG-1 layer<br />

<br />

LAYER


Audio Layer I ——<br />

32<br />

<br />

<br />

<br />

Audio Layer II ——<br />

<br />

Audio Layer III ——


Audio Layer III<br />

Audio Layer IAudio Layer II<br />

Audio Layer III ITU-R 60kbps<br />

<br />

Audio Layer III<br />

ISDN<br />

<br />

MPEG-1


MPEG-1


Layer III;


Layer III;


PCM<br />

<br />

MPEG-1


PCM<br />

<br />

MPEG-1


MPEG-1<br />

MPEG-1<br />

<br />

<br />

32


2 <br />

<br />

12 1111 1111 1111<br />

1 MPEG-1 <br />

2 <br />

1 <br />

4 15 <br />

2 44.1 kHz48 kHz32 kHz<br />

1 Slot<br />

1 <br />

2 <br />

2 <br />

1 <br />

1


MPEG-1<br />

MPEG-1


MPEG-1<br />

MPEG-1


MPEG-1<br />

<br />

-<br />

<br />

<br />

<br />

<br />

I II<br />

32<br />

1236<br />

<br />

III<br />

<br />

6*3218*32<br />

<br />

6*32


"<br />

<br />

"<br />

<br />

MPEG-1<br />

III<br />

<br />

III<br />

<br />

SMR III<br />

SMR


SMR


I<br />

II<br />

PCM<br />

<br />

III


MPEG-1<br />

<br />

2-10Hz


2.3 MPEG-1<br />

MPEG-1


2.3 MPEG-1<br />

MPEG-1


MPEG<br />

<br />

<br />

90khz


MPEG<br />

<br />

<br />

<br />

<br />

MPEG


MPEG-2<br />

<br />

3.1 <br />

3.2 <br />

3.3 MPEG-2<br />

3.4 MPEG-2<br />

3.5 MPEG-2 MPEG-1


3.1 <br />

MPEG<br />

19907 ITU-TS<br />

<br />

ATM<br />

H.262<br />

MPEG-2


1993<br />

"<br />

"<br />

DVB<br />

MPEG-2<br />

HDTV<br />

<br />

OFDM<br />

MPEG-2 ISO<br />

166311<br />

MPEG-2


3.2 <br />

<br />

<br />

<br />

<br />

MPEG-2<br />

<br />

<br />

MPEG-2


MPEG-2<br />

<br />

720*480<br />

CCIR-601<br />

MPEG-1<br />

4-10Mbps MPEG-1<br />

<br />

MPEG-1<br />

<br />

DBS (Direct Broadcast Satellite)CATV<br />

(Cable Television)DigiCipherHDTV


MPEG-2<br />

<br />

720*480<br />

CCIR-601<br />

MPEG-1<br />

4-10Mbps MPEG-1<br />

<br />

MPEG-1<br />

<br />

DBS (Direct Broadcast Satellite)CATV<br />

(Cable Television)DigiCipherHDTV


MPEG-2<br />

<br />

720*480<br />

CCIR-601<br />

MPEG-1<br />

4-10Mbps MPEG-1<br />

<br />

MPEG-1<br />

<br />

DBS (Direct Broadcast Satellite)CATV<br />

(Cable Television)DigiCipherHDTV


MPEG-2<br />

‣<br />

<br />

<br />

<br />

‣<br />

<br />

<br />

<br />

MPEG2 MP@ML<br />

MPEG2 4:2:2P@ML


‣<br />

<br />

MPEG2<br />

MPEG2 4:2:2<br />

<br />

<br />

MPEG


‣<br />

<br />

<br />

<br />

<br />

<br />

MPEG


‣<br />

<br />

<br />

/<br />

<br />

<br />

<br />

<br />

MPEG


‣ -<br />

<br />

MPEG2<br />

<br />

<br />

GOP<br />

<br />

<br />


3.3 MPEG-2<br />

MPEG-2<br />

MPEG-1<br />

<br />

<br />

<br />

HDTV<br />

<br />

/ H.261<br />

<br />

MAIN<br />

HDTV level,<br />

profile, 11


3 <br />

<br />

/ <br />

<br />

<br />

low 352x240x30 3.05 M 4 Mb/s CIF,<br />

main 720x480x30 10.40 M 15 Mb/s CCIR 601,<br />

1440 1440x1152x30 47.00 M 60 Mb/s 4x 601,<br />

High1440<br />

consumer HDTV<br />

high 1920x1080x30 62.70 M 80 Mb/s production<br />

SMPTE 240M std


4 MPEG-2 profile<br />

<br />

<br />

simple main <br />

B main CATV<br />

main+ <br />

CATV<br />

main+ 95%<br />

next SNR main<br />

main<br />

4:2:2 main+


5 MPEG-2


‣<br />

Main Profile at Main<br />

level MP@ML<br />

<br />

<br />

MPEG-1


‣<br />

Sample Profile at main<br />

level SP@ML


‣<br />

Main Profile at high level<br />

MP@HL<br />

<br />

HDTV<br />

80M <br />

‣-1441<br />

Spatial scalable<br />

profile at high 1440 level SSP@1440<br />

<br />

Scalable


3.4 MPEG-2<br />

MPEG-2<br />

(profile)<br />

<br />

MPEG-2<br />

Hierarchical coding


‣<br />

<br />

DCT<br />

‣<br />

<br />

downsample<br />

(upsample)<br />

<br />

MPEG-2


MPEG-2


HDTV


3.5 MPEG-2 MPEG-1<br />

<br />

<br />

‣ <br />

<br />

‣ DCT Huffman


‣<br />

MPEG-1(ISO/IEC1172)<br />

1.5Mbps, VCDDAB<br />

<br />

MPEG-2(ISO/IEC13818)<br />

10Mbps,<br />

(DVB)<br />

(HDTV)DVD<br />

<br />

<br />

MPEG-2


‣<br />

<br />

<br />

at I P B <br />

MPEG-1 SIF<br />

150,000<br />

@ 1.5 Mbps<br />

50,000 20,000 38,000<br />

MPEG-2 601<br />

400,000<br />

@4Mbps<br />

200,000 80,000 130,000


MPEG-1<br />

CPB(Constraned Parameters<br />

Bitetream),<br />

<br />

<br />

CPB<br />

25HZ<br />

396<br />

101376<br />

30HZ<br />

330<br />

84480


MPEG-1<br />

352*240*30fps352*288*25fps<br />

MPEG-1G<br />

<br />

MPEG-1<br />

<br />

CPB<br />

<br />

MPEG-2<br />

<br />

16


‣ MPEG-2<br />

<br />

MPEG-11-31<br />

0.5-56<br />

‣ MPEG-2DCT<br />

<br />

MPEG-1<br />

<br />

‣ MPEG-2<br />

DCT


‣ MPEG-2<br />

MPEG-1 -127-127 -2043-<br />

+2043<br />

‣ DCT<br />

‣ <br />

MPEG-2


‣ EOB<br />

MPEG-1EOB<br />

2 3<br />

4<br />

MPEG-2<br />

I EOB 4<br />

<br />

916<br />

‣ MPEG1 VLC<br />

G3<br />

MPEG2 INTRA


‣ MPEG-2MPEG-1<br />

<br />

<br />

‣ <br />

<br />

DRAM DRAM /<br />

MPEG-1 CPB 0.4 to .75 million 4 Mbit 16 bits @ 80 ns<br />

MPEG-1 601 0.8 to 1.1 million 16 Mbit 64 bits @ 80 ns<br />

MPEG-2 MP<br />

@ML<br />

0.9 to 1.5 million 16 Mbit 64 bits @ 80 ns<br />

MPEG-2<br />

MP@High1440 2 to 3 million 64 Mbit N/A


MPEG-4<br />

<br />

4.1 MPEG-4<br />

4.2 MPEG-4<br />

4.3 MPEG-4<br />

4.4 MPEG-4<br />

4.5 MPEG-4<br />

4.6


4.1 MPEG-4<br />

1988<br />

<br />

1) <br />

"JPEG"<br />

<br />

"H.261"


2) <br />

MPEG-1<br />

MPEG-2<br />

<br />

<br />

DCT<br />

Huffman<br />

MPEG-2<br />

MPEG-1


3C<br />

<br />

<br />

<br />

<br />

MPEG-1<br />

MPEG-2 "" ""<br />

<br />

<br />

" "<br />

"" " " "<br />

<br />

3C<br />

MPEG-2


3C<br />

<br />

<br />

<br />

<br />

MPEG-1<br />

MPEG-2 "" ""<br />

<br />

<br />

" "<br />

"" " " "<br />

<br />

3C<br />

MPEG-2


ISO<br />

<br />

MPEG 19937<br />

<br />

---MPEG-4<br />

19993<br />

ISO/IEC14496199912<br />

2


4.2 MPEG-4<br />

<br />

<br />

<br />

<br />

64kbps


4.3 MPEG-4<br />

<br />

<br />

MPEG-4 <br />

• <br />

<br />

<br />

<br />

<br />

• <br />

<br />

MSDL<br />

<br />

• <br />

<br />

MSDL <br />

<br />

• <br />

<br />

<br />

• <br />

<br />

<br />

• <br />

<br />

<br />

<br />

<br />

• <br />

<br />

<br />

• <br />

AV


• <br />

<br />

<br />

<br />

<br />

• <br />

MPEG-4 <br />

<br />

/<br />

<br />

<br />

/<br />

<br />

<br />

<br />

• <br />

<br />

<br />

• <br />

<br />

<br />


• <br />

• <br />

<br />

<br />

• <br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />


4.4 MPEG-4<br />

MPEG-4<br />

<br />

<br />

<br />

<br />

<br />

<br />

2D3D<br />

(<br />

)


(implicit)2D


MPEG-4<br />

<br />

MPEG-4<br />

<br />

<br />

<br />

/<br />

<br />

(View Dependent<br />

Application)<br />

MPEG-4


MPEG-1MPEG-2<br />

<br />

<br />

<br />

<br />

VLBV<br />

(VLBVVery Low Bit Rate Video)<br />

5-64kbits/s<br />

<br />

(<br />

352288 )<br />

( 15Hz)


VLBV<br />

(a)<br />

(b)<br />

<br />

<br />

<br />

<br />

<br />

FF/FR(<br />

/ )<br />

MPEG-4<br />

HBV(HBV: High Bit Rate Video<br />

64kbits/s-4Mbits/s )


ITU-R 601


MPEG-4<br />

Contentbased


4.5 MPEG-4<br />

<br />

<br />

VOP(Video Object Plane:<br />

)<br />

VOP


VOP(Video Object Plane:<br />

)


H.261MPEG-<br />

1/MPEG-2<br />

MPEG-4<br />

<br />

<br />

--<br />

<br />

<br />

MPEG-4 VOP


VOP(Video Object<br />

Plane)<br />

VOP<br />

VO(Video Object)VO


VOP<br />

(<br />

) ( )<br />

<br />

H.261MPEG-<br />

1/MPEG-2<br />

MPEG4<br />

<br />

VOP<br />

<br />

(Shape)<br />

(Transparency)<br />

<br />

<br />

MPEG-4<br />

VOP


H.261<br />

MPEG-1/MPEG-2<br />

<br />

VOPMPEG-4


VOP<br />

VOP


VOP<br />

<br />

1616 (Macroblock)<br />

<br />

<br />

<br />

VOP<br />

<br />

VOP (VOP<br />

Window),<br />

16<br />

VOP VOP


VOP<br />

<br />

<br />

VOP<br />

<br />

(88<br />

) -<br />

VOP<br />

(Intra)<br />

<br />

DCT<br />

AC<br />

<br />

(


VOP<br />

<br />

<br />

VOP<br />

<br />

(88<br />

) -<br />

VOP<br />

(Intra)<br />

<br />

DCT<br />

AC<br />

<br />

(


MPEG-4<br />

VO<br />

<br />

<br />

01 VOP<br />

0 VOP 1 VOP<br />

<br />

<br />

<br />

0255<br />

VOP<br />

<br />

DCT (<br />

<br />

)


(<br />

)


MPEG-4<br />

<br />

<br />

<br />

VOP<br />

VOP 3 (Intraframe)<br />

(I-VOP) (Interframe)<br />

(P-VOP)<br />

(Bidirectionally)<br />

(B-VOP)


MPEG-4<br />

1616<br />

88<br />

VOPMPEG-4<br />

(Image Padding)<br />

(Polygon Matching)<br />

VOP<br />

<br />

<br />

VOP


MPEG-4 8<br />

<br />

SPRITE<br />

<br />

VOP<br />

<br />

8


I-VOP<br />

B-VOP<br />

P-VOP


88<br />

DCT<br />

VOP<br />

DCT<br />

VOP<br />

<br />

VOP VOP<br />

<br />

VOP<br />

<br />

DCT<br />

<br />

DCT DCAC


B-VOP<br />

P-VOP<br />

<br />

VOP<br />

128<br />

SADCT(Shape-adaptive DCT) VOP<br />

<br />

<br />

<br />

DCT<br />

( )


B-VOP<br />

P-VOP<br />

<br />

VOP<br />

128<br />

SADCT(Shape-adaptive DCT) VOP<br />

<br />

<br />

<br />

DCT<br />

( )


B-VOP<br />

P-VOP<br />

<br />

VOP<br />

128<br />

SADCT(Shape-adaptive DCT) VOP<br />

<br />

<br />

<br />

DCT<br />

( )


MPEG-4<br />

VOL(Video Object Layer)<br />

2<br />

VOL<br />

<br />

<br />

VOP<br />

VOP<br />

<br />

VO(<br />

VO)


4.6 <br />

MPEG-4<br />

<br />

3C<br />

<br />

19991<br />

( ISO/IEC 14496) 1999<br />

11


MPEG-1/MPEG-<br />

2VCD/DVD<br />

MPEG<br />

MPEG<br />

<br />

MPEG<br />

<br />

<br />

<br />

MPEG-4


--<br />

<br />

<br />

MPEG-4


MPEG-7


MPEG-4<br />

<br />

<br />

MPEG-4<br />

MPEG<br />

MPEG-7<br />

<br />

Multimedia Content Description<br />

Interface


MPEG-7 MPEG-4<br />

<br />

<br />

<br />

<br />

2001MPEG-7

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!