StorPool Performance Test: 12 SSDs = 468,000 IOPS

Boyan Ivanov Blog Leave a Comment

A small stand-alone storage system with just 12x Intel S3510 SATA SSDs, worth $35k over 3 years. Only $0.07/IOPS

This is a performance test of a small stand-alone, all-flash storage system, which we delivered early 2017 for a customer. It is quite impressive, both in terms of overall performance metrics (storage performance IOPS, MB/s, latency) and also in terms of capital efficiency – $/IOPS, $/GB for such a system.

System under test:
3 storage nodes, each with:
– Dell R330 server
– CPU: Intel Xeon E3-1230v5
– RAM: 2x 16 GB DDR4 UDIMM @2133 MT/s
– NIC: 2-port Intel X710 10GbE NICs
– HBA: Dell PERC H730 adapter in JBOD mode (Avago 3108 w/ OEM firmware)
– 4x Intel S3510 1.6 TB
– Linux kernel version: 3.10.0-514.2.2.el7.x86_64

Total storage system resources:
– 3 storage nodes
– 6x 10GE ports
– 12x S3510 1.6 TB SSDs. 19.2 TB total raw space

Network:
– 2x IBM/Blade Networks G8124 – 24-port 10GbE switch
– Direct-attach SFP+ cables

5 initiators (hypervisors), each with:
– Dell R630 server
– CPU: 2x Intel Xeon E5-2620v4
– RAM: 16x 16GB DDR4 RDIMM @2133 MT/s
– 4-port Intel X710 10GbE NICs, 2 ports used for storage
– Linux kernel version: 2.6.32-642.11.1.el6.x86_64
– StorPool software version: 16.01.248.9d12c0a

Test system and parameters:
– Test was performed from all 5 client hosts in parallel to show total system throughput
– Test performed on All-SSD storage pool with 2 copies and usable capacity 8,128 GiB
– Test performed on 5x 100 GiB volumes
– Volumes were configured to store 2 copies on SSDs, taking total approx 1,100 GiB raw space (including copies and protection)
= this allocation policy provides maximum 8,128 GiB usable space from the available SSDs
– Test performed from 5 initiators in parallel to show total system throughput
– Performance testing tool: FIO, version 2.0.13, AIO, Direct

Test results: Storage performance IOPS

Storage performance iops

Storage performance iops

Storage performance iops

Measured storage latency under different load levels:
– Test was performed from one initiator with different load levels, to show latency under load
– At the high end of the queue depth scale, this test is limited by capability of the initiator, not by the whole storage system

StorPool 12 SSDs table latencyNote: When used from multiple initiators, this storage system can deliver at least 200,000 IOPS random read+write 4k at sub-1 ms latency

StorPool 12 SSDs latency

The cost of this system as tested was just $35,000 over 36 months. This makes $4/GB usable and $0.07/IOPS. The system scales seamlessly and online with small steps. First upgrade is filling the empty bays of the servers, which doubles capacity and reduces price to $3.6/GB.

Leave a Reply

Your email address will not be published. Required fields are marked *