Dotaz: Mikrotik - OpenVPN over UDP (RouterOS 7.0beta8)

[PetebLazar]

Vypadá to, že podpora UDP pro OpenVPN by mohla vyřešit některé negativní vlastnosti provozu OpenVPN přes TCP.

Motivován příspěvky ve vedlejší diskusi o významu laboratorních zkušeností (ve srovnání s praktickými) /konec ironie/ rozhodl jsem se provést v Subj určité pokusy.

Jako Mikrotik jsem zvolil RB4011, ktery se svym quad core ARM A15 CPU poskytuje relativně slušný výkon i bez využití akcelerace šifrování.

Mezi OpenVPN_klienta a Mikrotik jsem vřadil linuxový bridge se dvěma 1Gbps NIC, kde pomocí tc (Traffic Control) na jednom z jeho rozhraní byla zajištěna definovaná ztrátovost packetů (v %). Nezkoumal jsem zda se ztrátovost aplikuje v obou směrech komunikace.

Za Mikrotikem byl Linux,ze ktereho byly pomocí protokolů SMB/FTP přenášena data směrem k klientovi.

Zatímco při spojení OpenVPN přes UDP při ztrátovosti v jednotkách packetů došlo k relativně malému poklesu přenosových rychlostí 12MB/s->11MB/s (iperf3 maximum na RouterOS 6.47 bylo cca 13MB/s). Při přepnnutí na OpenVPN přes TCP došlo při podobné ztrátovosti k poklesu rychlosti přenosu na stovky KB/s.

Jakou máte vy zkušenost se Subj?

Odpovědi

Diskuse byla administrátory uzamčena.
FAQ: Proč byl uzamčen/smazán můj dotaz v Poradně?

[PetebLazar]

Pozn. Došlo mi, že se v prvotním testu zpoždění pravděpodobně aplikovalo asi pouze v jednom směru. Jinak by při přidané latenci 10ms byla doba trvání pingu 20ms=2x10ms. Zkusím v dalších pokusech aplikovat pomocí tc latence na obou síťových rozhraních bridge.

Pokusy probíhali na RB4011 se stable RouterOS 6.47 (OpenVPN over TCP). Před každým benchmarkem je ověření doby latence pomocí pingu.

Bez přidané latence

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time<1ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=1ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=1ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=1ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 1ms, Average = 0ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 49584 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  15.0 MBytes   126 Mbits/sec
[  4]   1.00-2.00   sec  16.1 MBytes   135 Mbits/sec
[  4]   2.00-3.00   sec  15.8 MBytes   132 Mbits/sec
[  4]   3.00-4.00   sec  15.8 MBytes   132 Mbits/sec
[  4]   4.00-5.00   sec  15.8 MBytes   132 Mbits/sec
[  4]   5.00-6.00   sec  15.6 MBytes   131 Mbits/sec
[  4]   6.00-7.00   sec  15.8 MBytes   132 Mbits/sec
[  4]   7.00-8.00   sec  16.0 MBytes   134 Mbits/sec
[  4]   8.00-9.00   sec  15.8 MBytes   132 Mbits/sec
[  4]   9.00-10.00  sec  15.8 MBytes   132 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   157 MBytes   132 Mbits/sec                  sender
[  4]   0.00-10.00  sec   157 MBytes   132 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 5ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=5ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=6ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=6ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=6ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 5ms, Maximum = 6ms, Average = 5ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 50480 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.6 MBytes  89.1 Mbits/sec
[  4]   1.00-2.00   sec  11.6 MBytes  97.6 Mbits/sec
[  4]   2.00-3.00   sec  11.5 MBytes  96.4 Mbits/sec
[  4]   3.00-4.00   sec  11.6 MBytes  97.5 Mbits/sec
[  4]   4.00-5.00   sec  11.5 MBytes  96.5 Mbits/sec
[  4]   5.00-6.00   sec  11.8 MBytes  98.4 Mbits/sec
[  4]   6.00-7.00   sec  11.6 MBytes  97.6 Mbits/sec
[  4]   7.00-8.00   sec  11.5 MBytes  96.5 Mbits/sec
[  4]   8.00-9.00   sec  11.6 MBytes  97.5 Mbits/sec
[  4]   9.00-10.00  sec  11.5 MBytes  96.4 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   115 MBytes  96.4 Mbits/sec                  sender
[  4]   0.00-10.00  sec   115 MBytes  96.4 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 10ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=10ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=11ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=11ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=11ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 10ms, Maximum = 11ms, Average = 10ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 49679 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  7.75 MBytes  65.0 Mbits/sec
[  4]   1.00-2.00   sec  9.00 MBytes  75.5 Mbits/sec
[  4]   2.00-3.00   sec  9.12 MBytes  76.5 Mbits/sec
[  4]   3.00-4.00   sec  9.62 MBytes  80.8 Mbits/sec
[  4]   4.00-5.00   sec  10.8 MBytes  90.2 Mbits/sec
[  4]   5.00-6.00   sec  10.8 MBytes  90.2 Mbits/sec
[  4]   6.00-7.00   sec  10.9 MBytes  91.1 Mbits/sec
[  4]   7.00-8.00   sec  10.8 MBytes  90.3 Mbits/sec
[  4]   8.00-9.00   sec  10.8 MBytes  90.2 Mbits/sec
[  4]   9.00-10.00  sec  10.8 MBytes  90.1 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   100 MBytes  84.0 Mbits/sec                  sender
[  4]   0.00-10.00  sec   100 MBytes  84.0 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 20ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=21ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=21ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=20ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=21ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 20ms, Maximum = 21ms, Average = 20ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 50008 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  4.25 MBytes  35.6 Mbits/sec
[  4]   1.00-2.00   sec  5.62 MBytes  47.2 Mbits/sec
[  4]   2.00-3.00   sec  5.75 MBytes  48.2 Mbits/sec
[  4]   3.00-4.00   sec  5.62 MBytes  47.2 Mbits/sec
[  4]   4.00-5.00   sec  5.75 MBytes  48.2 Mbits/sec
[  4]   5.00-6.00   sec  5.75 MBytes  48.3 Mbits/sec
[  4]   6.00-7.00   sec  5.75 MBytes  48.2 Mbits/sec
[  4]   7.00-8.00   sec  5.38 MBytes  45.1 Mbits/sec
[  4]   8.00-9.00   sec  4.88 MBytes  40.9 Mbits/sec
[  4]   9.00-10.00  sec  5.62 MBytes  47.2 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  54.4 MBytes  45.6 Mbits/sec                  sender
[  4]   0.00-10.00  sec  54.4 MBytes  45.6 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 40ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=41ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=41ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=41ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=41ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 41ms, Maximum = 41ms, Average = 41ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 50121 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  2.00 MBytes  16.8 Mbits/sec
[  4]   1.00-2.00   sec  3.00 MBytes  25.1 Mbits/sec
[  4]   2.00-3.00   sec  3.00 MBytes  25.2 Mbits/sec
[  4]   3.00-4.00   sec  2.88 MBytes  24.1 Mbits/sec
[  4]   4.00-5.00   sec  2.88 MBytes  24.1 Mbits/sec
[  4]   5.00-6.00   sec  2.75 MBytes  23.1 Mbits/sec
[  4]   6.00-7.00   sec  2.75 MBytes  23.1 Mbits/sec
[  4]   7.00-8.00   sec  2.88 MBytes  24.1 Mbits/sec
[  4]   8.00-9.00   sec  2.88 MBytes  24.1 Mbits/sec
[  4]   9.00-10.00  sec  2.88 MBytes  24.1 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  27.9 MBytes  23.4 Mbits/sec                  sender
[  4]   0.00-10.00  sec  27.9 MBytes  23.4 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 80ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=81ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=81ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=81ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=81ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 81ms, Maximum = 81ms, Average = 81ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 50206 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   640 KBytes  5.23 Mbits/sec
[  4]   1.00-2.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   2.00-3.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   3.00-4.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   4.00-5.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   5.00-6.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   6.00-7.00   sec  1.38 MBytes  11.5 Mbits/sec
[  4]   7.00-8.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   8.00-9.00   sec  1.50 MBytes  12.6 Mbits/sec
[  4]   9.00-10.00  sec  1.50 MBytes  12.6 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  14.0 MBytes  11.7 Mbits/sec                  sender
[  4]   0.00-10.00  sec  14.0 MBytes  11.7 Mbits/sec                  receiver

iperf Done.

S přidanou latencí 160ms

c:\Winapp\iperf-3.1.3-win64>ping 192.168.51.179 -l 1400

Pinging 192.168.51.179 with 1400 bytes of data:
Reply from 192.168.51.179: bytes=1400 time=161ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=160ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=160ms TTL=64
Reply from 192.168.51.179: bytes=1400 time=160ms TTL=64

Ping statistics for 192.168.51.179:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 160ms, Maximum = 161ms, Average = 160ms

c:\Winapp\iperf-3.1.3-win64>iperf3.exe -c 192.168.88.254
Connecting to host 192.168.88.254, port 5201
[  4] local 10.15.32.34 port 50273 connected to 192.168.88.254 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   256 KBytes  2.10 Mbits/sec
[  4]   1.00-2.00   a zatím nZatím se to jeví nestabilní,.sec   384 KBytes  3.14 Mbits/sec
[  4]   2.00-3.00   sec   896 KBytes  7.35 Mbits/sec
[  4]   3.00-4.00   sec   768 KBytes  6.29 Mbits/sec
[  4]   4.00-5.00   sec   768 KBytes  6.30 Mbits/sec
[  4]   5.00-6.00   sec   768 KBytes  6.29 Mbits/sec
[  4]   6.00-7.00   sec   768 KBytes  6.30 Mbits/sec
[  4]   7.00-8.00   sec   768 KBytes  6.28 Mbits/sec
[  4]   8.00-9.00   sec   768 KBytes  6.29 Mbits/sec
[  4]   9.00-10.00  sec   768 KBytes  6.30 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  6.75 MBytes  5.66 Mbits/sec                  sender
[  4]   0.00-10.00  sec  6.75 MBytes  5.66 Mbits/sec                  receiver

iperf Done.

Vypadá to, že při nízkých latencích (vysokých rychlostech) se narazí na výkonnost CPU Mikrotiku (jedno z jader bylo opřeno o 95%+ vytížení), ve středních latencích (vyšší x0ms ) kdy se CPU již nejeví bottleneckem je vidět prakticky lineární závislost dosažené rychlosti iperf3 na latencích.

Při měření pomocí reálných aplikací SMB/FTP přenosu zkrze VPN rychlost značně oscilovala, ale na výrazně vyšších hodnotách (až násobně) než u iperf3 benchmarku. Vliv latence tam určitý je, s rostoucí latencí rychlost přenosu klesá, ale méně výrazně.

[Max]

Hele, je mi to líto, ale fakt, pro volnou diskusi a soupisky nastavení, testování atd. použij blog. Poradna vždy byla o pomoci, technický dotaz, technická odpověď atd. Takto to tu funguje od nepaměti a zatím není v plánu změna.
Takže lock, nechám to tu, aby byl kdyžtak čas si to přesunout do blogu.
Zdar Max