Sitemaps and hypertext links are "food" for search engine robots. We will look at the value of text links for optimal spidering, and the importance of using a sitemap in order to help search engine robots reach your website's deeper pages. Hypertext Links