27.11.2012 Views

Realtime Apache Hadoop at Facebook

Realtime Apache Hadoop at Facebook

Realtime Apache Hadoop at Facebook

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Typical Cell Layout<br />

▪ Multiple cells for messaging<br />

▪ 20 servers/rack; 5 or more racks per cluster<br />

▪ Controllers (master/Zookeeper) spread across racks<br />

ZooKeeper<br />

HDFS NameNode<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

Rack #1<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

19x... 19x... 19x... 19x... 19x...<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

ZooKeeper<br />

Backup NameNode<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

ZooKeeper<br />

Job Tracker<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

ZooKeeper<br />

HBase Master<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

ZooKeeper<br />

Backup Master<br />

Region Server<br />

D<strong>at</strong>a Node<br />

Task Tracker<br />

Rack #2 Rack #3 Rack #4 Rack #5

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!