The Optimizer

Google's Jeff Dean

Courtesy Google.

?The speed of light in a vacuum used to be about 35 mph. Then Jeff Dean spent a weekend optimizing physics.??Jeff Dean Facts

Jeff Dean facts aren?t, well, true. But the fact that someone went to the trouble to make up Chuck Norris-esque exploits about Dean is remarkable. That?s because Jeff Dean is a software engineer, and software engineers are not like Chuck Norris. For one thing, they?re not lone rangers?software development is an inherently collaborative enterprise. For another, they rarely shoot cowboys with an Uzi.

Nevertheless, on April Fool?s Day 2007, some admiring young Google engineers saw fit to bestow upon Jeff Dean the honor of a website extolling his programming achievements. For instance:

• Compilers don?t warn Jeff Dean. Jeff Dean warns compilers.
• Jeff Dean writes directly in binary. He then writes the source code as documentation for other developers.
• When Jeff Dean has an ergonomic evaluation, it is for the protection of his keyboard.
• Jeff Dean was forced to invent asynchronous APIs one day when he optimized a function so that it returned before it was invoked.

Here?s a true Jeff Dean fact: You have to be a computer whiz to understand most of the jokes that people tell about Jeff Dean. (For those interested, Business Insider offers helpful explanations of some of the more popular ones.) But if his fake accomplishments are hard to understand without a real computer-science background, his real accomplishments are even more abstruse. The programs that Dean was instrumental in building?MapReduce, BigTable, Spanner?are not the ones most Google users associate with the company. But they?re the kind that made Google?and, consequently, much of the modern Web as we know it?possible. And the projects he?s working on now have the potential to revolutionize information technology once again.

When you think of the people who built today?s Web, you probably conjure founders and CEOs: Tim Berners-Lee, Marc Andreessen, Larry Page and Sergey Brin, maybe Mark Zuckerberg. That makes sense: Each of those people invented a product or framework that shaped how we use the Internet.

Meanwhile, in the shadows of these giants?all of whom have graduated from day-to-day gruntwork?are legions of faceless developers who tap away at keyboards every day to build the products and systems we all use. In the tech world, more so than in most other industries, those employees are far from interchangeable. A great accountant might save you 5 percent on your taxes. A great baseball player will reach base just a bit more often than a mediocre baseball player. But a great software developer can do in a week what might take months for a team of 10 lesser developers?the difference is exponential rather than marginal. That?s not a Jeff Dean fact; it?s conventional wisdom in Silicon Valley, which is why the best companies go to such great lengths to attract top talent.

Dean arrived at Google in mid-1999 having already earned a reputation as one of the country?s top young computer scientists. Growing up when home computing power was just blossoming, Dean says he was always looking for ways to push the limits of what you could do on a given machine. As a high schooler, he wrote software for analyzing vast sets of epidemiological data that he says was ?26 times faster? than what professionals were using at the time. The system, called Epi Info, has been adopted by the Centers for Disease Control and translated into 13 languages. And as a Ph.D. student in computer science, he worked on compilers, programs that translate source code into a language that a computer can readily execute. ?I?ve always liked code that runs fast,? he explains matter-of-factly.

But Dean has always been restless in his interests, and he didn?t want to work on compilers his whole life. So he left academia and landed less than three years later at Google, which had only about 20 employees at the time. (According to Steven Levy?s book In the Plex, the search startup saw Dean as something like a prized draft pick.) After contributing some important early work to Google News and AdSense, the advertising product that would rewrite the rules of the Internet economy, he turned his attention to one of the company?s core problems: scale.

Google?s founding ideas came from Page and Brin, world-class developers in their own right. In the late 1990s they built PageRank, an algorithm for returning the most relevant results to a given search query. The focus on relevance put Google on a course to surpass Yahoo, AltaVista, and the day?s other leading search engines. But as the upstart grew in popularity, it faced a tremendous computing challenge. ?We couldn?t deploy machines fast enough? to keep up with demand, Dean recalls.

So Dean, working with fellow standout programmer Sanjay Ghemawat and others, did what he had done in high school with Epi Info: found software solutions to what seemed like hardware problems. Ghemawat helped lead a team that built the Google File System, which allowed for huge files to be efficiently distributed across thousands of cheap servers. Then Dean and Ghemawat developed a programming tool called MapReduce that allowed developers to efficiently process gargantuan data sets with those machines working in parallel. Much as a compiler allows a programmer to write code without worrying about the nitty-gritty of how the CPU will process it, MapReduce allowed Google?s developers to tweak the search algorithm or add new computations without having to worry about how to parallelize the operation or handle equipment failures.?

Source: http://feeds.slate.com/click.phdo?i=d78ba1ce0e207190d5055ae277445136

cough matt groening brandon phillips summerfest summerfest fidel castro rick santorum