I have two HP microservers: one runs Rockstor under ESXi with the drives passed through as RAW devices (RDMs); the other runs Rockstor natively. Both have 3 LAN-facing network adapters (NICs). Does anyone have any experience of bonding or teaming NICs, and what options are best to get the most speed out of replication?
Originally both appliances were running under ESXi with each using just one NIC. When replicating shares between the boxes I was getting about 35-40MB/s. I tried using NIC-teaming in ESXi and the replication rate dropped to 20MB/s - possibly because my switch doesn’t support 802.3ad link aggregation.
I have now rebuilt the second appliance to run natively, removed NIC-teaming from the ESXi Rockstor appliance and given both access to three LAN facing NICs.
I have about 3TB of data to replicate across my GB network and I’d like it to run as quickly as possible. Plus I’d like to get teaming / bonding to work because why not.
ESXi appliance has 4x3GB WD Red running in RAID10 plus an SSD for Rockstor (and the other ESXi VMs). The native appliance has 7 disks of various sizes totalling 3.5TB, setup as a “single” pool, and a USB stick for Rockstor. I would really like to max out the network for replication.
Does anyone have any advice as on:
Whether to choose bonding or teaming?
Which options to choose within the above - loadbalance, round robin etc?
Which would work best (if at all) for three NICs?
Note, my switch doe NOT support 802.3ad, but I would consider upgrading it if there was evidence to suggest it would give me a major speed bump under a particular setup. Both appliances are running 3.8-14.