Experiments

This section details the experiments using compressed storage. The experiments was done using two datasets: 1) SocialGen dataset and 2) Synthetic Tweets and was conducted using two type of hard drives (External HDD using USB 3.0 and SSD).

Configuration Setup:

• OS: OSX 10.11.6 (El Capitan)
• Memory: 16GB
• Hard drives read/write peaks:
  • SSD (Read: ~715MB/s Write: ~640MB/s) 
  • HDD: HDD (Read: ~100MB/s Write: ~100MB/s)

AsterixDB Configuration:

• Buffer Cache: 7GB
• Buffer Cache Page Size: 256KB

Social Gen (Data Scan):

• GleambookMessages raw size: 46GB 
• Comparing: Uncompressed and Compressed with: Snappy,LZ4 and LZ4HC
• Load: Bulkload
• # of IODevices: 2

On-disk size:

Data Scan execution time:

Using query: SELECT COUNT(*) FROM GleambookMessage

The query is executed 7 times and we dropped the first two.

• SSD Result (lower is better)

• HDD Result (lower is better)