Zestaw do upgrade-u:
1. Switch zarządzalny – KeepLink KP-9000-9XHML-X – 2 szt.
2. Karta FENVI 2.5G PCI-E (RTL8125B) – 4 szt.
3. Karta Gigabit Ethernet USB3.0/Type-C na RJ45 2,5G (RTL8156B) – 2 szt.
4. Kilka Kabeli Ethernet Cat6
Koszt zestawu: 530,58 zł
Czas dostawy tydzień.
Upgrade objął łączność klastera proxmox (4 węzły), TrueNas-a i mojego PC.
Wyniki zgodnie z oczekiwaniem. Dla wszystkich serwerowych kart ustawiłem MTU 9000. Teraz wyniki na Ceph też zdecydowanie się polepszyły.
iperf3 -c proxmox4.local
Connecting to host proxmox4.local, port 5201
[ 5] local 192.168.0.230 port 36504 connected to 192.168.0.98 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 297 MBytes 2.49 Gbits/sec 0 813 KBytes
[ 5] 1.00-2.00 sec 292 MBytes 2.45 Gbits/sec 0 813 KBytes
[ 5] 2.00-3.00 sec 290 MBytes 2.43 Gbits/sec 0 813 KBytes
[ 5] 3.00-4.00 sec 295 MBytes 2.48 Gbits/sec 0 979 KBytes
[ 5] 4.00-5.00 sec 295 MBytes 2.48 Gbits/sec 0 1.01 MBytes
[ 5] 5.00-6.00 sec 289 MBytes 2.42 Gbits/sec 0 1.11 MBytes
[ 5] 6.00-7.00 sec 294 MBytes 2.47 Gbits/sec 0 1.16 MBytes
[ 5] 7.00-8.00 sec 295 MBytes 2.48 Gbits/sec 0 1.16 MBytes
[ 5] 8.00-9.00 sec 294 MBytes 2.47 Gbits/sec 0 1.16 MBytes
[ 5] 9.00-10.00 sec 290 MBytes 2.43 Gbits/sec 0 1.16 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 2.86 GBytes 2.46 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 2.86 GBytes 2.46 Gbits/sec receiver
iperf Done.
rados bench -p ceph 10 write -t 4 --no-cleanup
hints = 1
Maintaining 4 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects
Object prefix: benchmark_data_proxmox_2909507
sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s)
0 0 0 0 0 0 - 0
1 4 37 33 131.978 132 0.198432 0.107997
2 4 86 82 163.976 196 0.0655723 0.0963192
3 4 134 130 173.3 192 0.081349 0.0913185
4 4 193 189 188.968 236 0.0668475 0.0841324
5 4 250 246 196.769 228 0.0801945 0.0805697
6 4 295 291 193.972 180 0.0627416 0.0819929
7 4 350 346 197.687 220 0.0636238 0.0802182
8 4 409 405 202.473 236 0.0528717 0.0786326
9 4 456 452 200.864 188 0.050302 0.0794492
10 4 513 509 203.573 228 0.11992 0.0783168
Total time run: 10.0505
Total writes made: 513
Write size: 4194304
Object size: 4194304
Bandwidth (MB/sec): 204.169
Stddev Bandwidth: 32.793
Max bandwidth (MB/sec): 236
Min bandwidth (MB/sec): 132
Average IOPS: 51
Stddev IOPS: 8.19824
Max IOPS: 59
Min IOPS: 33
Average Latency(s): 0.0781883
Stddev Latency(s): 0.0442148
Max latency(s): 0.350276
Min latency(s): 0.0336858