Keeping the pace with latest developments done by other search engines Google has rolled out it’s new web indexing system called CAFFEINE. The new search engine is fast in indexing the newly published webpage’s all the website or blogs are given equal importance. The new approach is quite different from the old one where website’s were treated differently as popular sites very refreshed more frequently than other not so popular sites.
The new system, rather than troll through the web site by site now chugs through it in small portions. This, they say, has the effect of a continuously updating index with newer, fresher results in it.
Caffeine lets us index web pages on an enormous scale. In fact, every second Caffeine processes hundreds of thousands of pages in parallel. If this were a pile of paper it would grow three miles taller every second. Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day. You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles.
We’ve built Caffeine with the future in mind. Not only is it fresher, it’s a robust foundation that makes it possible for us to build an even faster and comprehensive search engine that scales with the growth of information online, and delivers even more relevant search results to you. So stay tuned, and look for more improvements in the months to come.