Page History

GSoC 2010: ZooKeeper Monitoring Recipes and Web-based Administrative Interface

• Student: http://andreisavu.ro/ Andrei Savu (savu.andrei at gmail dot com)
• Assigned mentor: Patrick Hunt (phunt at apache dot org)

...

ZooKeeper is a complex distributed system. Understanding how well it is running is tremendously important. Patrick Hunt has created a http://github.com/phunt/zookeeper_ Django-based dashboard that allows some insight into how ZooKeeper is running. This is the foundation I'm going to build on. This project would capture much more information from ZooKeeper, adding hooks to retrieve it where necessary and visualize it in an appealing and useful way. I'm also going to provide a bunch of monitoring recipes for systems like: Ganglia, Nagios, Cacti.

...

• https://issues.apache.org/jira/browse/ZOOKEEPER-808
  • Hue Application: http://github.com/andreisavu/hue^{Image Removed} (branch: zookeeper-browser app: apps/zkui)
• https://issues.apache.org/jira/browse/ZOOKEEPER-809
  • will open another JIRA for ACLs (get, set) and per session ZK authentication
• https://issues.apache.org/jira/browse/ZOOKEEPER-732
  • added some fixes on the existing patch created by Lei Zhang
• https://issues.apache.org/jira/browse/ZOOKEEPER-765
• https://issues.apache.org/jira/browse/ZOOKEEPER-799
  • Github Repository: http://github.com/andreisavu/zookeeper-monitoring
• https://issues.apache.org/jira/browse/ZOOKEEPER-744
• https://issues.apache.org/jira/browse/ZOOKEEPER-754

...

• understand source code and the known bugs - done
• understand how the software is used in production - done
  • ZooKeeper is the kind of service that you put in production and forget about it
  • got positive feedback: works as expected "out of the box"
  • monitoring requirements: ensure that it keeps working as expected
• understand monitoring requirements - done
• understand debugging requirements - done
• setup a development environment - done
  • on the local machine running Ubuntu 9.10, java1.6, Eclipse, ant
  • tracking my changes on github: http://github.com/andreisavu/zookeeper^{Image Removed}

Monitoring and Data Collection (starts: 24 May ends: 20 June )

...

• package zkpython bindings (distutils, .deb, .rpm) done
  • • already available: apt-get install python-zookeeper
    • https://wiki.cloudera.com/display/DOC/ZooKeeper+Installation^{Image Removed}
• simple authentication and custom authentication backend based on zookeeper
  • • not needed: the web-based application will use the authentication provided by Hue
• view server, environment and connection info: most of the code already works done
  • • I've rewrite all the code in the Hue application
    • The code uses 4letter word commands: 'stat' and 'mntr'
• znode hierarchy browser done
  • • you can navigate and perform simple CRUD operations on znodes
• deploy on production or development cluster at Adobe (if possible) work in progress
  • • this should be pretty easy if Adobe is also using Hue

...