THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
This Here is a list of projects ideas for new contributors if they who want to work on something new.
If you are interested about any of them, you can start a discussion at dev@ozone.apache.org mailing list, where the details can be discussed or more help can be given.
Sizing Chart:
- Small generally indicates a work that is less than 500-1000 lines of code.
- Medium is code patches between 1000--3000
- Large - Beyond that.
- XXL - is I don’t really know.
...
- Configuration protocol for SCM
- https://docs.google.com/document/d/11Okhp0r9YnOpvTwenMtgPO5i19-BWUyBGBNxKCOUaaQ/edit
- https://docs.google.com/document/d/1Bh0SKDsMFLGB4k8BVWE9lozapn8CeGFPKLKqldi1L0Q/edit
- Size : Medium
- S3 Load balancing - This is a work in progress based on the ideas from Craig Conduit from Target. I need to write down these ideas, but they have a successful load balancing pattern they use inside their cluster. We will borrow those ideas for S3 load balancing for Ozone.
- Size : Medium
- Trash - Matt from target is already driving this project. We can sync up and post patches with in this project.
- Size: Medium
- HDDS-2416 – in progress.
- Old Config to new config translations - https://docs.google.com/document/d/1LYcir2-0K16-I4ZKNRrQLrz1GRLmMG8GTNEQ3OcpJcM/edit --
- Chris Teoh is working with me on this -- but there are so many to convert this is a gold mine of patches. Easy,
- Size: Medium.
- SSD aware datanode -- if there are SSDs on the data node, we would like to use SSD as a cache and as the Ratis Log location. We also need a background thread that can move older files to spinning disks.
- Size : Medium
- Security architecture for the containers - we need to add some metadata and checking on containers to create them securely. This would mean that container creation will need to move to a client pipeline.
- Size: Small
- Certificate Server - Revoke Certificate - apurohit is probably going to work on this-
- Size: small
- Certificate Server - Manual approval of Data node certificates -
- Size: Medium
- Generic Token Service -
- Size: Small/Medium
- Modification of Block Size --
- Size: Small
- Modification of Blocks to Support Multiple SCMs. -
- Size: Small/Medium
- SCM to have the ability to support multiple OMs groups - depend on the container security (6) -
- Small
- Ozone to Ozone upgrade -
- Size:Large ??
- rolling upgrade
- Object Version Support :
- Medium
- Ozone in-place upgrades - XXL -
- XXL
- HDDS-1266
- Fix the open key cleanup thread -
- Size:small
- Translate docs to Chinese -- (HDDS-2708) – in progress
- Size:Small
- Add Object ID and Change ID to Buckets :
- Size: very small
- Add Object ID and Change ID to Keys :
- Size: very small
- Add modification time for Volume/Bucket (HDDS-426) : – in progress
- Size: very small
- Track tests that fail -- build an historical report for Ozone.
- Size:Small
- Add notion of ServiceName or Domain to OM certificates - part of generic token design - apurohit.
- Size: very small
- Create an NIO based Ozone client. - -
- Size: Small/Medium.
- reference HDFS
- Rename S3Token to something like S3AuthInfo.- Size: Very small.
- Ozone Client(Python) for Data Science Notebook such as Jupyter - .
- Size: Large
- - PyArrow: https://pypi.org/project/pyarrow/
- - Python -> libhdfs HDFS JNI library (HDFS, S3,...) -> Java client API Impala uses libhdfs
- How Jupyter iPython work: https://jupyter.readthedocs.io/en/latest/architecture/how_jupyter_ipython_work.html
- Eco, Architecture:https://ipython-books.github.io/chapter-3-mastering-the-jupyter-notebook/
- HDDS-2443