Benjamin Reed - wicked mad scientist

Research Area: Search Technologies
Location: Yahoo! Research Silicon Valley

Profile

i've worked almost 2 decades in industry. from an intern working on cad/cam systems, to shipping and receiving applications in OS/2, AIX, and CICS, to operations, to system admin research and java frameworks at IBM Almaden Research (11 years), until finally arriving at Yahoo! Research (3 years ago) to work on the largest (and therefore coolest) distributed computing problems. my main interests now are large scale processing environments and highly available and scalable systems. i've worked quite a bit in open source: i wrote and maintained the linux aironet wireless driver years ago; my research project at ibm grew into osgi (i think some of my code is still there) which is now in application servers, ides, cars, and mobile phones; two projects i worked on in research, Pig and ZooKeeper, are apache projects for which i am a committer.

Recent Publications, Projects and News

  • PNUTS - Platform for Nimble Universal Table Storage - During brainstorming sessions with colleagues Philip Bohannon and Brian Cooper, Ramakrishnan wondered whether they could design a simpler...
  • Ideological Search - In what some may consider the boldest move by a tech research organization, scientists at Yahoo! today released Ideological Search – an innovative new search that allows users to control the ideology of their search results for the first time in search technology history.
  • Zookeeper - Distributed computing is sort of like herding cats. If not properly managed, chaos results.
  • Pig - Parallel processing is the name of the game. Our system runs on a cluster computing architecture, on top of which sit several layers of abstraction that ultimately bring the power of parallel computing into the hands of ordinary users.
  • Yahoo! Research at SIGMOD/PODS 2008 - The 28th ACM SIGMOD International Conference on Management of Data/Principles of Database Systems was held June 9 to 12 in beautiful Vancouver, British Columbia. The joint conference is universally regarded as the leading international forum for database researchers, practitioners, developers, and users.
  • Milestone Week in Evolving History of Data-Intensive Computing - The last week of March 2008 saw the emergence of a significant new era in the world of data-intensive scalable computing. Co-sponsored by the Computing Community Consortium (CCC) and Yahoo!, the first-ever Hadoop Summit took place on March 25 in Santa Clara, followed by the first Data-Intensive Computing Symposium on March 26 at Yahoo!’s Sunnyvale headquarters.