Three years ago, a top Google engineer named Vijay Gill was asked what he would do if someone gave him a magic wand.
At the time, Gill helped run the massive network of data centers that underpins Google’s online empire, and he was sitting on stage at a conference in downtown San Francisco, discussing the unique challenges facing this globe-spanning operation. Jonathan Heilger — the man who oversaw Facebook’s data centers — sat a few seats away, and it was Heiliger who asked Gill what he would add to Google’s data centers if he had a magic wand.
Gill hesitated before answering. And when he did answer, he was coy. But he seemed to say he would use that magic wand to build a single system that could automatically and instantly juggle information across all of Google’s data centers. Then he indicated that Google had already built one. “How do you manage the system and optimize it on a global level?” he said. “That is the interesting part.”
It was little more than a teaser. But about four months later, Google dropped another hint. At a symposium in the mountains of Montana, Jeff Dean — one of Google’s most important engineers — revealed that the web giant was working on something called Spanner, describing it as a “storage and computation system that spans all our data centers.” He said the plan was to eventually juggle data across as many as 10 million servers sitting in “hundreds to thousands” of data centers across the globe.
The scope of the project was mind-boggling. But Dean provided few details, and it wasn’t clear whether Google was actually using the platform in its live data centers. Then, on Tuesday, the paper hit the web.
This week, as reported by GigaOm and ZDnet, Google published a research paper detailing the ins and outs of Spanner. According to Google, it’s the first database that can quickly store and retrieve information across a worldwide network of data centers while keeping that information “consistent” — meaning all users see the same collection of information at all times — and it’s been driving the company’s ad system and various other web services for years.
Spanner borrows techniques from some of the other massive software platforms Google built for its data centers, but at its heart is something completely new. Spanner plugs into a network of servers equipped with super-precise atomic clocks or GPS antennas akin to the one in your smartphone, using these time keepers to more accurately synchronize the distribution of data across such a vast network. That’s right, Google attaches GPS antennas and honest-to-goodness atomic clocks to its servers.
Our IP Address: