You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

This is a list of projects for new contributors if they want to work on something new.

Sizing Chart:

  • Small generally indicates a work that is less than 500-1000 lines of code.
  • Medium is code patches between 1000--3000
  • Large - Beyond that.
  • XXL - is I don’t really know.


  1. Configuration protocol for SCM 
    1. https://docs.google.com/document/d/11Okhp0r9YnOpvTwenMtgPO5i19-BWUyBGBNxKCOUaaQ/edit
    2. https://docs.google.com/document/d/1Bh0SKDsMFLGB4k8BVWE9lozapn8CeGFPKLKqldi1L0Q/edit 
    3. Size : Medium
  2. S3 Load balancing - This is a work in progress based on the ideas from Craig Conduit from Target. I need to write down these ideas, but they have a successful load balancing pattern they use inside their cluster. We will borrow those ideas for S3 load balancing for Ozone. Size : Medium
  3. Trash - Matt from target is already driving this project. We can sync up and post patches with in this project. Size: Medium
  4. Old Config to new config translations - https://docs.google.com/document/d/1LYcir2-0K16-I4ZKNRrQLrz1GRLmMG8GTNEQ3OcpJcM/edit  -- Chris Teoh is working with me on this -- but there are so many to convert this is a gold mine of patches. Easy, Size: Medium.
  5. SSD aware datanode -- if there are SSDs on the data node, we would like to use SSD as a cache and as the Ratis Log location. We also need a background thread that can move older files to spinning disks. Size : Medium
  6. Security architecture for the containers - we need to add some metadata and checking on containers to create them securely. This would mean that container creation will need to move to a client pipeline. Size: Small
  7. Certificate Server - Revoke Certificate - apurohit is probably going to work on this- Size: small
  8. Certificate Server - Manual approval of Data node certificates - Size: Medium
  9. Generic Token Service - Size: Small/Medium https://docs.google.com/document/d/1_iUBKnbodPoQCzUuhlrTaXD4W_mmySeby660v60ibis/edit
  10. Modification of Block Size -- Size: Small
  11. Modification of Blocks to Support Multiple SCMs. - Size: Small/Medium
  12. SCM to have the ability to support multiple OMs groups - depend on the container security (6) - Small
  13. Ozone to Ozone upgrade - Size:Large ??
    1. rolling upgrade
  14. Object Version Support : Medium
  15. Ozone in-place upgrades - XXL -HDDS-1266
  16. Fix the open key cleanup thread - Size:small
  17. Translate docs to Chinese -- Size:Small
  18. Add Object ID and Change ID to Buckets : Size: very small
  19. Add Object ID and Change ID to Keys : Size: very small
  20. Add modification time for Volume/Bucket (HDDS-426) : Size: very small
  21. Track tests that fail -- build an historical report for Ozone. Size:Small
  22. Add notion of ServiceName or Domain to OM certificates - part of generic token design - apurohit. Size: very small
  23. Create an NIO based Ozone client. - Size: Small/Medium. -reference HDFS
  24. Rename S3Token to something like S3AuthInfo.- Size: Very small.
  25. Ozone Client(Python) for Data Science Notebook such as Jupyter - Size: Large
    1. -  PyArrow: https://pypi.org/project/pyarrow/
    2. - Python -> libhdfs HDFS JNI library (HDFS, S3,...) -> Java client API Impala uses                      libhdfs
    3. How Jupyter iPython work: https://jupyter.readthedocs.io/en/latest/architecture/how_jupyter_ipython_work.html
    4. Eco, Architecture:https://ipython-books.github.io/chapter-3-mastering-the-jupyter-notebook/
  • No labels