MAS 801 It's a Discreetly Discrete World Ã¢Â€Â“ Mathematics in Real-life ...

More documents

Recommendations

Info

Lecture 9: 22 October 2008 Crawler • Program that browses WWW in a methodical, automated fashion • The process is called crawling or spidering • downloads a copy of all the visited pages for later use by an indexer • Characteristics of WWW that makes crawling difficult • WWW has large volume • can only download a fraction of the web pages in a given time; need to prioritize which page to download • WWW has fast rate of change • by the time the pages of a site are downloaded, new pages may have been added, or content of pages may have changed • Behaviour of a crawler is governed by its policies • Selection policy: which page to download • Revisit policy: when to check for changes
Lecture 9: 22 October 2008 Indexer • The indexer builds an index from the downloaded web pages • The index contains keywords and key phrases that points back to the web pages containing them
Page 1 and 2: Lecture 9: 22 October 2008 MAS 801
Page 3 and 4: Lecture 9: 22 October 2008 Proving
Page 5 and 6: Lecture 9: 22 October 2008 Proving
Page 7 and 8: Lecture 9: 22 October 2008 Exercise
Page 9 and 10: The Mathematics of Lecture 9: 22 Oc
Page 11 and 12: Lecture 9: 22 October 2008 How Big
Page 13 and 14: How Big is the Web (Graph) Lecture
Page 15: Lecture 9: 22 October 2008 Overview
Page 19 and 20: Lecture 9: 22 October 2008 Ranking
Page 21 and 22: Lecture 9: 22 October 2008 PageRank
Page 23 and 24: Lecture 9: 22 October 2008 Adjacenc
Page 31 and 32: Lecture 9: 22 October 2008 Markov M
Page 41 and 42: Lecture 9: 22 October 2008 Eigenval
Page 43 and 44: Lecture 9: 22 October 2008 Eigenval

MAS 801 It's a Discreetly Discrete World Ã¢Â€Â“ Mathematics in Real-life ...

Create successful ePaper yourself

Delete template?

Save as template?