ZooKeeper: High-Performance Coordination for Distributed Systems
ZooKeeper is a distributed coordination service that prioritizes high availability and performance over consistency. Managed by Apache and initially developed by Yahoo!, it offers a hierarchical namespace, client-server architecture, and various API functions for implementing primitives like locks and barriers. Used by companies like Rackspace, Zynga, and Apache projects such as Hadoop and Kafka.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
ZooKeeper Justin Magnotti 9/19/18
What is ZooKeeper? Wait-free coordination for Internet-scale systems Favors high availability and high performance over consistency Managed by Apache, originally developed by Yahoo!
Background/Motivation Most coordination systems serve a single purpose Create a flexible, simple, wait-free service Distributed coordination is difficult
ZooKeeper Architecture Hierarchical Namespace consisting of nodes
ZooKeeper Architecture Client-server Watches
ZooKeeper Architecture Linearizable writes FIFO clients Non-specific primitives Read-extensive
ZooKeeper Nodes Regular or Ephemeral Can be used to implement locking and other primitives Watches Helps with client caching
ZooKeeper API create(path, data, flags) delete(path, version) exists(path, watch) getData(path, watch) setData(path, watch, version) getChildren(path, watch) sync(path) Asynchronous
Primitive Examples Configuration Management Most common use Rendezvous Unknown configuration at startup Group Membership Ephemeral child nodes Locks Ephemeral nodes Double Barriers Start and End
ZooKeeper Applications Commonly used as a configuration management service Rackspace Zynga Yahoo! Apache Hadoop MapReduce (Yarn) Apache HBase Apache Kafka
ZooKeeper Service Implementation Request Processor Idempotent Atomic Broadcast Zab Replicated Database Snapshots Client-Server Fast Reads
ZooKeeper Evaluation Throughput
ZooKeeper Evaluation Reliability
Related Work Chubby Distributed lock management ISIS Replication and fault tolerance AFS Cache callbacks
Conclusion High availability Fast reads Flexible
