Google Introduces New Search Indexing System

Google, the pioneer in web search has just released their new search indexing system - Caffeine. Caffeine works a little different then Google’s previous indexing structure.

Due to the large amounts of data which Google had been processing for the last 10 years, billions upon billions of pages had to be re-evaluated every time new algorithms where introduced.  Luckily for us SEO’s and Designers out there, Google has finally went to a more “real-time” approach.  CAFFEINE (near and dear to the heart of every programmer) is the new name for this system.

In essences Google is now refreshing it’s content more often, and on demand when needed thus giving the user faster and more accurate results.

This image depicts essentially what Google is doing differently with Caffeine.

Google's caffeine search indexing

caffeine search indexing

As explained by Google:

Our old index had several layers, some of which were refreshed at a faster rate than others; the main layer would update every couple of weeks. To refresh a layer of the old index, we would analyze the entire web, which meant there was a significant delay between when we found a page and made it available to you.

With Caffeine, we analyze the web in small portions and update our search index on a continuous basis, globally. As we find new pages, or new information on existing pages, we can add these straight to the index. That means you can find fresher information than ever before—no matter when or where it was published.

Related Posts

06/01/2010

Implementing Amazon S3 Service

Ever want to change the image's location on your large website, but afraid of changing code in 40000 places? Well fear no more, with this technique you can use the .HTACCESS file to redirect all of the folder's traffic to the destination of your choice. In our case, we're going to forward it to a CNAME sub domain which points to out Amazon S3 service bucket.

Read more
05/31/2010

Google Wave Turns 1 Year Old

Google Wave, Happy Birthday. I still have not figured out how you can fit into my daily life, but I'm glad you're here.

Read more

Leave a reply