1A program that automatically “crawls” web sites, i.e. downloads a page and then moves on to the next one by following the links included in the first page.