http://deepwebtechblog.com/crawling-the-deep-web/ covering federated search and how to get the best from the Deep Web. Thu, 28 Jul 2011 20:58:58 +0000 hourly 1 http://wordpress.org/?v=3.1 http://deepwebtechblog.com/crawling-the-deep-web/comment-page-1/#comment-7448 http://www.danjiw.com/ Wed, 19 May 2010 10:13:44 +0000 http://deepwebtechblog.com/?p=494#comment-7448 If Google can’t find the data, where exactly is it and why can’t it be crawled?” If Google can’t find the data, where exactly is it and why can’t it be crawled?”

]]> http://deepwebtechblog.com/crawling-the-deep-web/comment-page-1/#comment-6888 dave tribbett Tue, 13 Apr 2010 05:37:23 +0000 http://deepwebtechblog.com/?p=494#comment-6888 Good post and comments, <a href="http://tastethecloud.com/content/deep-dark-invisible-web" rel="nofollow"><b>HERE</b></a> is an article that adds additional detail to the topic and a good set of links to the deep web search engines and other helpful sites. The Internet of Things will add considerably content to the deep web creating huge information shadows for each device or thing connected. Couple this with the continued growth of mobile computing and you can see where this goes. I think the end result is that specialized search engines become more and more important as only they will be able to traverse and catalog the content in a way that makes it accessible beyond a link. Call it consumable results instead of link results. Good post. Good post and comments, HERE is an article that adds additional detail to the topic and a good set of links to the deep web search engines and other helpful sites.
The Internet of Things will add considerably content to the deep web creating huge information shadows for each device or thing connected. Couple this with the continued growth of mobile computing and you can see where this goes. I think the end result is that specialized search engines become more and more important as only they will be able to traverse and catalog the content in a way that makes it accessible beyond a link. Call it consumable results instead of link results.
Good post.

]]>