untangling_the_web

DID: 4046925
UNCLASSIFIEDNFOR OFFl6IAL USE OP4LY
Tips for Navigating the "Hidden Web"
1. Always examine and follow the links from "links pages" at an
interesting site (it's quite possible that those links lead to webpages
that are not indexed).
2. Try uri guessing, i.e., just try what you think might be the address of
a site you're looking for and you might get lucky. Do pay attention to
any domain naming conventions widely used in a particular country.
The Russians often use cities as part of the name, e.g.,
http://www.pager.nnov-fu; many other countries use the conventions
of .co for companies, .ae for educational institutions, e.g.,
http://www.aid.eo.ator http://www.ua.ae.be, etc.).
3. Spend time browsing a country's domain name registry; many of
these registries list "all" the websites in their top-level domain (more
on how to find a country registry later).
4. Visit a country-specific website devoted to listing "all" the sites for
that country and browse or search their list (you will undoubtedly find
a number of websites not indexed by US-based and focused search
engines).
276 UNCLASSIFIEDNFOR OFFl6IAL USE ONLY