Google’s Matt Cutts is giving a keynote at SMX and is discussing the roll out of the Caffeine update.

Apparently in the last few days, Caffeine went live on all data centers.  

According to Matt, in the past Google used to roll out large updates using a “Google Dance” whereby datacenters updated gradually.   In 2003 Google introduced an incremental indexing system in which they crawled 10% of the web every night which was pushed out to all datacenters nightly.   This update system was known as Fritz.

The new crawl algorithm is now known as Caffeine.   With the new update, pages crawled are immediately added to the index and will instantly appear in the SERPs.

According to Matt – the results are 50% fresher and Caffeine enables Google to scale up their index in a massive way.