what's your hard drive model ? maybe raid0 I guess ?

[changchichung]

your benchmark result is so awesome ! I'm curious what is your raid type / harddisk model&numbers ?

Start 1 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 1.34675 s, 12.8 GB/s
Start 2 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 1.36288 s, 12.6 GB/s
Start 3 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 1.42878 s, 12.0 GB/s
Start 4 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 1.37079 s, 12.5 GB/s
Start 5 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 1.35658 s, 12.7 GB/s

and here is mine , single plextor M9PEGN 512G NVME SSD

2019-09-06 14:00:01 [changch@hqdc034 iobench]$ sudo ./iobench.sh --megabytes 16384 --sync
Target directory: .
Testfile size: 16384 x 1 Megabyte

1. Write benchmark without cache
17179869184 bytes (17 GB, 16 GiB) copied, 32.56 s, 528 MB/s
2. Write benchmark with cache
17179869184 bytes (17 GB, 16 GiB) copied, 31.6189 s, 543 MB/s
3. Read benchmark with dropped cache
17179869184 bytes (17 GB, 16 GiB) copied, 9.66748 s, 1.8 GB/s
4. Read benchmark without cache drop
Start 1 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 9.57576 s, 1.8 GB/s
Start 2 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 9.57289 s, 1.8 GB/s
Start 3 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 9.55484 s, 1.8 GB/s
Start 4 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 9.58037 s, 1.8 GB/s
Start 5 of 5...
17179869184 bytes (17 GB, 16 GiB) copied, 9.59213 s, 1.8 GB/s

[perryflynn]

Hi,

I am using ZFS with 4x 6TB WD Red Pro in my setup. They are configured as two mirror vdevs which build one volume. In "RAID-speech" this equals to RAID 10.

ZFS is configured with 16 GB of RAM Cache.

But also above the 16 GB the performance is quite nice:

# /root/iobench.sh --dir . --megabytes $((128*1024)) --sync
Target directory: .
Testfile size: 131072 x 1 Megabyte

1. Write benchmark without cache
137438953472 bytes (137 GB, 128 GiB) copied, 46,2839 s, 3,0 GB/s

2. Write benchmark with cache
137438953472 bytes (137 GB, 128 GiB) copied, 45,1767 s, 3,0 GB/s

3. Read benchmark with droped cache
137438953472 bytes (137 GB, 128 GiB) copied, 14,6879 s, 9,4 GB/s

4. Read benchmark without cache drop

Start 1 of 5...
137438953472 bytes (137 GB, 128 GiB) copied, 12,2445 s, 11,2 GB/s

Start 2 of 5...
137438953472 bytes (137 GB, 128 GiB) copied, 12,2301 s, 11,2 GB/s

Start 3 of 5...
137438953472 bytes (137 GB, 128 GiB) copied, 12,052 s, 11,4 GB/s

Start 4 of 5...
137438953472 bytes (137 GB, 128 GiB) copied, 12,0616 s, 11,4 GB/s

Start 5 of 5...
137438953472 bytes (137 GB, 128 GiB) copied, 12,0545 s, 11,4 GB/s

Done.

[changchichung]

thanks ! , that's really awesome benchmark score !