E E 3J2 D ata M ining L ecture 3 Z ipf's L aw Stem m ing & Stop L ists
E E 3J2 D ata M ining L ecture 3 Z ipf's L aw Stem m ing & Stop L ists
E E 3J2 D ata M ining L ecture 3 Z ipf's L aw Stem m ing & Stop L ists
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
‘Resolv<strong>ing</strong> Power’ of words<br />
3000<br />
‘Resolv<strong>ing</strong> power’ of word<br />
2500<br />
2000<br />
1500<br />
Zipf’s L<strong>aw</strong><br />
1000<br />
Frequency<br />
500<br />
Words too rare<br />
0<br />
106<br />
99<br />
92<br />
85<br />
78<br />
71<br />
64<br />
57<br />
50<br />
43<br />
36<br />
29<br />
22<br />
15<br />
8<br />
1<br />
Words<br />
too<br />
common<br />
Word (ranked by frequency)<br />
Upper cutoff Lower cutoff<br />
EE<strong>3J2</strong> D<strong>ata</strong> M<strong>in<strong>ing</strong></strong> 2008 – l<strong>ecture</strong> 3<br />
Slide 20