dc

. Self Information
c. Logarithmic measure for information
56. Write short notes on the following
a. Entropy
b. Conditional entropy
c. Mutual Information
d. Information
57. A DMS has an alphabet of eight letters, Xi , i=1,2,3,….,8, with probabilities
0.36,0.14,0.13,0.12,0.1,0.09,0.04,0.02.
i. Use the Huffman encoding procedure to determine a binary code for the
source output.
ii. Determine the entropy of the source and find the efficiency of the code
58. A DMS has an alphabet of eight letters, Xi , i=1,2,3,….,8, with probabilities
{0.05,0.1,0.1,0.15,0.05,0.25,0.3}
i. Use the Shannon-fano coding procedure to determine a binary code for the
source output.
ii. Determine the entropy of the source and find the efficiency of the code. An
analog signal band limited to 10HKz quantize is 8levels of PCM System with
59. Probability of 1/4/1/5, 1/5, 1/10,1/20,1/20, and 1/20 respectively. Find the entropy and rate
of information.
60. Explain various methods for describing conventional methods.
61. Explain about block codes in which each block of k message bits encoded into
block of n>k bits with an example.
62. Consider a (6,3) generator matrix
1 0 0 0 1 1
G = 0 1 0 1 0 1
0 0 1 1 1 0
Find
a) All the code vectors of this code.
b) The parity check matrix for this code.
c) The minimum weight of the code.
63 . What is the hardware components required to implement a cyclic code encoder.
64. Explain about the syndrome calculation, error correction and error detection in
(n, k) cyclic codes.
65. Briefly discuss about the linear block code error control technique.