...

Concurrent file transfer

Modifying OODT thread number

The performance of OODT PushPull was evaluated for directory transfer using a directory structure of 16x1024MB binary files. This would result in an averaged outcome compared to single file transfer and also eliminating some anomalies which arose in some cases.

PushPull has the option of specifying the number of threads for download of multiple files in parallel e.g (/cas­pushpull­0.6/etc/push_pull_framework.properties):

org.apache.oodt.cas.pushpull.file.retrieval.system.recommended.thread.count=4

which will be used when the optimised variable is set to false:

org.apache.oodt.cas.pushpull.crawler.use.tracker=false

By manually setting the number of threads for concurrent file transfer, the optimised thread number was found to be 4 which was therefore used for further benchmarking of concurrent file transfer on a modified network.

Image Added