Large-Scale Deep Learning For Building Intelligent Computer Systems
Jeff Dean (Google, Inc., Senior Fellow)
CSE Distinguished Lecture Series
Thursday, February 26, 2015, 3:30pm
EEB-105
Abstract
Over the past few years, we have built large-scale computer systems for training neural networks, and then applied these systems to a wide variety of problems that have traditionally been very difficult for computers. We have made significant improvements in the state-of-the-art in many of these areas, and our software systems and algorithms have been used by dozens of different groups at Google to train state-of-the-art models for speech recognition, image recognition, various visual detection tasks, language modeling, language translation, and many other tasks. In this talk, I'll highlight some of the distributed systems and algorithms that we use in order to train large models quickly. I'll then discuss ways in which we have applied this work to a variety of problems in Google's products, usually in close collaboration with other teams.
This talk describes joint work with many people at Google.
Bio
Jeff joined Google in 1999 and is currently a Google Senior Fellow in Google's Knowledge Group, where he leads Google's deep learning research team in Mountain View. He has co-designed/implemented five generations of Google's crawling, indexing, and query serving systems,
and co-designed/implemented major pieces of Google's initial advertising and AdSense for Content systems. He is also a co-designer and co-implementor of Google's distributed computing infrastructure, including the MapReduce, BigTable and Spanner systems, protocol buffers, LevelDB, systems infrastructure for statistical machine translation, and a variety of internal and external libraries and developer tools. He is currently working on large-scale distributed systems for machine learning. He received a Ph.D. in Computer Science from the University of Washington in 1996, working with Craig Chambers on compiler techniques for object-oriented languages. He is a Fellow of the ACM, a Fellow of the AAAS, a member of the U.S. National Academy of Engineering, and a recipient of the Mark Weiser Award and the ACM-Infosys Foundation Award in the Computing Sciences.