Comments on: You can’t spider XML with a Google Mini (so far) /2007/01/16/spider-xml-google-mini/ Google Search Appliance and Google Mini development Fri, 14 Mar 2014 15:00:46 +0000 hourly 1 http://wordpress.org/?v=4.2.2 By: Jason Grovert /2007/01/16/spider-xml-google-mini/comment-page-1/#comment-6622 Mon, 04 Feb 2008 18:57:47 +0000 /2007/01/16/spider-xml-google-mini/#comment-6622 We create a sitemap.xml file which contains all the pages on our site. We have ~7000 pages so far. Is there a way we can configure Google Mini to load a page (that we create using the sitemap.xml file) that has all 7000 links, and the Google Mini goes and crawls just those 7000 pages? (And nothing else that it finds in those 7000 pages)?

]]>