Comments on: You can’t spider XML with a Google Mini (so far) http://www.gsadeveloper.com/2007/01/16/spider-xml-google-mini/ Google Search Appliance and Google Mini development Mon, 08 Sep 2008 08:34:45 +0000 http://wordpress.org/?v=2.5.1 By: Jason Grovert http://www.gsadeveloper.com/2007/01/16/spider-xml-google-mini/#comment-6622 Jason Grovert Mon, 04 Feb 2008 18:57:47 +0000 http://www.gsadeveloper.com/2007/01/16/spider-xml-google-mini/#comment-6622 We create a sitemap.xml file which contains all the pages on our site. We have ~7000 pages so far. Is there a way we can configure Google Mini to load a page (that we create using the sitemap.xml file) that has all 7000 links, and the Google Mini goes and crawls just those 7000 pages? (And nothing else that it finds in those 7000 pages)? We create a sitemap.xml file which contains all the pages on our site. We have ~7000 pages so far. Is there a way we can configure Google Mini to load a page (that we create using the sitemap.xml file) that has all 7000 links, and the Google Mini goes and crawls just those 7000 pages? (And nothing else that it finds in those 7000 pages)?

]]>