Slides - University of Washington
Slides - University of Washington
Slides - University of Washington
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>University</strong> <strong>of</strong> <strong>Washington</strong><br />
Ling472 Introduction to Computational Linguistics<br />
Lecture 1:<br />
Introduction<br />
Primitive tokenization<br />
$ cat moby_dick.html | # echo the text<br />
tr [:upper:] [:lower:] | # convert to lower case<br />
tr ' ' '\n' |<br />
# put each word on a line<br />
grep ‐v ^$ |<br />
# get rid <strong>of</strong> blank lines<br />
grep ‐v '