For the web-savvy

One method of excluding specific pages from a web search is to use the robots attribute. This attribute controls whether or not search robots are allowed to index a page. It is supported by several major search engines.


Search robots: an automated software program that methodically visits web sites and reads web pages. Based on the information they find, search robots create entries in search engines’ indexes to help determine search results. Search robots also called ‘web crawlers.’