Realtime Apache Hadoop at Facebook

More documents

Recommendations

Info

HBase System Overview Storage Layer Database Layer Master Backup Master Region Server Region Server Region Server HBASE Namenode Secondary Namenode Datanode Datanode Datanode HDFS . . . ZK Peer ZK Peer . . . Coordination Service . . . Zookeeper Quorum
HBase in a nutshell ▪ Sorted and column-oriented ▪ High write throughputHorizontal scalability Automatic failoverRegions sharded dynamically
Page 2 and 3: Realtime Apache Hadoop at Facebook
Page 4: Why Hadoop and HBase? For Realtime
Page 7 and 8: Specialized solutions ▪ High-thro
Page 9 and 10: HBase satisfied our requirements
Page 11: Apache HBase ▪ Originally part of
Page 15 and 16: Use Case 1 Titan (Facebook Messages
Page 17 and 18: Facebook Messaging ▪ High write t
Page 20 and 21: Horizontal Scalability Region . . .
Page 22: Use Case 2 Puma (Facebook Insights)
Page 26 and 27: Puma as Realtime MapReduce ▪ Map
Page 30 and 31: Use Case 3 ODS (Facebook Internal M
Page 32 and 33: Dynamic sharding of regions Region
Page 34 and 35: User and Graph Data in HBase
Page 36 and 37: Conclusion ▪ Facebook investing i

Realtime Apache Hadoop at Facebook

Create successful ePaper yourself

Delete template?

Save as template?