Hello,
I'm in the process of setting up a new gateway. The local network will be connected via 2x Intel I350, configured as lagg / LACP.
Another FreeBSD machine, also with 2xI350 configured as lagg/LACP is used for testing.
This is the rc.conf on both machines for the lagg and VLAN configuration:
(of course the second machine gets another IP address...)
Using the lagg0 interfaces directly (eg. setting an IP address on lagg0 and running iperf with these IPs) works as expected. Iperf3 shows a constant 991-992Mbit/s throughput.
But if I run the benchmarks over the vlan interface I'm stuck with this:
Neither iperf nor netperf can seem to get any traffic through the VLAN devices. However I can log in on that IP via SSH without any problem (connecting host MTU at 1500 or 9000). Both hosts can also connect via ssh, pinging each other etc.
Trying to transfer a file via scp or even simple nc fails, and on the receiving side tcpdump shows a lot of packages with 'length 0'.
All switches in the network are cisco SG300 series with jumbo frames enabled. Both systems are currently plugged into the same switch with the corresponding ports configured as LAGs /w LACP active. I also temporarily connected the systems directly with 2 patch cables to rule out any glitches on the switch, but still get the same results.
If I revert the igb interfaces back to MTU 1500, transfers and metrics on the vlan device are working and iperf showing ~940MBit/s throughput on lagg0 and vlan5.
I couldn't find any limitations on lagg or vlan with jumbo frames in the manpages or documentation. Searching the forums or the interwebs only revealed some limitations/bugs regarding the MTU with some specific chipsets, but as the lagg0 performs well with a MTU of 9000 I doubt there's any problem on the hardware or driver side...
Are there any knobs for VLAN I have to adjust for jumbo frames?
I'm not terribly dependent on these last 50Mbits, but it would be nice to know what the problem is (and if it can be resolved).
I'm in the process of setting up a new gateway. The local network will be connected via 2x Intel I350, configured as lagg / LACP.
Another FreeBSD machine, also with 2xI350 configured as lagg/LACP is used for testing.
This is the rc.conf on both machines for the lagg and VLAN configuration:
Code:
cloned_interfaces="lagg0"
ifconfig_igb0="-lro -tso -vlanhwtag mtu 9000 up"
ifconfig_igb1="-lro -tso -vlanhwtag mtu 9000 up"
ifconfig_lagg0="laggproto lacp laggport igb0 laggport igb1 192.168.10.1/24"
cloned_interfaces+="vlan5"
ifconfig_vlan5="inet 10.50.50.1/24 vlan 5 vlandev lagg0"
Using the lagg0 interfaces directly (eg. setting an IP address on lagg0 and running iperf with these IPs) works as expected. Iperf3 shows a constant 991-992Mbit/s throughput.
But if I run the benchmarks over the vlan interface I'm stuck with this:
Code:
# iperf3 -c 10.50.50.100
Connecting to host 10.50.50.100, port 5201
[ 4] local 10.50.50.1 port 25257 connected to 10.50.50.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.06 sec 43.0 KBytes 331 Kbits/sec 2 76.4 MBytes
[ 4] 1.06-2.06 sec 0.00 Bytes 0.00 bits/sec 1 76.4 MBytes
[ 4] 2.06-3.06 sec 0.00 Bytes 0.00 bits/sec 1 76.4 MBytes
[ 4] 3.06-4.06 sec 0.00 Bytes 0.00 bits/sec 0 76.4 MBytes
[ 4] 4.06-5.06 sec 0.00 Bytes 0.00 bits/sec 1 76.4 MBytes
[ 4] 5.06-6.06 sec 0.00 Bytes 0.00 bits/sec 0 76.4 MBytes
[ 4] 6.06-7.05 sec 0.00 Bytes 0.00 bits/sec 0 76.4 MBytes
[ 4] 7.05-8.04 sec 0.00 Bytes 0.00 bits/sec 0 76.4 MBytes
[ 4] 8.04-9.03 sec 0.00 Bytes 0.00 bits/sec 1 76.4 MBytes
[ 4] 9.03-10.01 sec 0.00 Bytes 0.00 bits/sec 0 76.4 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.01 sec 43.0 KBytes 35.2 Kbits/sec 6 sender
[ 4] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec receiver
iperf Done.
Neither iperf nor netperf can seem to get any traffic through the VLAN devices. However I can log in on that IP via SSH without any problem (connecting host MTU at 1500 or 9000). Both hosts can also connect via ssh, pinging each other etc.
Trying to transfer a file via scp or even simple nc fails, and on the receiving side tcpdump shows a lot of packages with 'length 0'.
All switches in the network are cisco SG300 series with jumbo frames enabled. Both systems are currently plugged into the same switch with the corresponding ports configured as LAGs /w LACP active. I also temporarily connected the systems directly with 2 patch cables to rule out any glitches on the switch, but still get the same results.
If I revert the igb interfaces back to MTU 1500, transfers and metrics on the vlan device are working and iperf showing ~940MBit/s throughput on lagg0 and vlan5.
I couldn't find any limitations on lagg or vlan with jumbo frames in the manpages or documentation. Searching the forums or the interwebs only revealed some limitations/bugs regarding the MTU with some specific chipsets, but as the lagg0 performs well with a MTU of 9000 I doubt there's any problem on the hardware or driver side...
Are there any knobs for VLAN I have to adjust for jumbo frames?
I'm not terribly dependent on these last 50Mbits, but it would be nice to know what the problem is (and if it can be resolved).