Sites make this easier with clear navigation, quick loading, and a useful sitemap. Crawling starts with a program often called a spider or bot. At each stop, it reads the page, records the links it finds, and saves the information before moving on. If