Solved LAGG shows up but no traffic. 9.3_stable w/ Broadcom 5720 / Netgear GS724T

master-richie

master-richie

FreeNAS 9.3 (FreeBSD 9.3_stable) w/ Dell branded Broadcom 9720 dual port NIC
Netgear GS724T.v3 smart switch

Lagg setup is easy via the GUI and everything seems correct on both the server and the Netgear switch based on howto's.

bge0 and bge1 are physically on the card and for data
bge2 is the motherboard NIC that I use as admin access.

My LACP links show up BUT I get host is down when I ping the gateway ...
# ping 10.0.2.1
Code: 
PING 10.0.2.1 (10.0.2.1): 56 data bytes
ping: sendto: Host is down
ping: sendto: Host is down
ping: sendto: Host is down
ping: sendto: Host is down
^C

My # ifconfig -v:
Code: 
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
  ether 00:0a:f7:79:7e:58
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect (1000baseT <full-duplex>)
  status: active

bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
  ether 00:0a:f7:79:7e:58
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect (1000baseT <full-duplex>)
  status: active

bge2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=c0099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,VLAN_HWTSO,LINKSTATE>
  ether 00:9c:02:a0:3e:15
  inet 10.0.1.10 netmask 0xffffff00 broadcast 10.0.1.255
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect (1000baseT <full-duplex>)
  status: active

ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536
  nd6 options=9<PERFORMNUD,IFDISABLED>

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
  options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
  inet6 ::1 prefixlen 128
  inet6 fe80::1%lo0 prefixlen 64 scopeid 0xb
  inet 127.0.0.1 netmask 0xff000000
  nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
  groups: lo

lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
  ether 00:0a:f7:79:7e:58
  inet 10.0.2.2 netmask 0xfffffff0 broadcast 10.0.2.15
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect
  status: active
  groups: lagg
  laggproto lacp lagghash l2,l3,l4
  lag id: [(8000,00-0A-F7-79-7E-58,018B,0000,0000),
  (0000,00-26-F2-FF-37-71,0034,0000,0000)]
  laggport: bge1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3D
  [(8000,00-0A-F7-79-7E-58,018B,8000,0002),
  (0000,00-26-F2-FF-37-71,0034,0002,0014)]
  laggport: bge0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3D
  [(8000,00-0A-F7-79-7E-58,018B,8000,0001),
  (0000,00-26-F2-FF-37-71,0034,0001,0013)]

vlan10: flags=8842<BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
  options=103<RXCSUM,TXCSUM,TSO4>
  ether 00:0a:f7:79:7e:58
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect
  status: active
  vlan: 10 parent interface: lagg0
  groups: vlan

bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
  ether 02:7e:af:d9:78:00
  nd6 options=1<PERFORMNUD>
  groups: bridge
  id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
  maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
  root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
  member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
  ifmaxaddr 0 port 15 priority 128 path cost 2000
  member: bge2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
  ifmaxaddr 0 port 3 priority 128 path cost 20000

epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
  options=8<VLAN_MTU>
  ether 02:66:35:00:0f:0a
  nd6 options=1<PERFORMNUD>
  media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
  status: active
  groups: epair

I have no idea how to troubleshoot a LAGG via FreeBSD nor am I proficient with programming device drivers. What's my next step? Thanks!
 
Last edited by a moderator:
For some reason I can't edit my post but I forgot to mention if I reconfigure everything for vlan10 only, then it all works as expected so the problem isn't in my vlan - is definitely LAGG related.

And my Broadcom card is a Dell branded 5720 ... not 9720 - I'm sick today, my head isn't thinking clearly! lol
 
Last edited by a moderator:
Silly me... a little knowledge goes a long way. FreeNAS's dependency on it's global default route is what was the matter in this example - I have since discovered that setfib(1) in FreeBSD is used to assign different gateways to different processes - not sure if FreeNAS supports this (even though it is a part of FreeBSD 9.3 kernel). Am currently setting up a FreeBSD www devel server using setfib(1) + lagg(4) (lacp) + vlans + sysutils/ezjail and will try to use the command on my FreeNAS box if / when successful

BTW, I know this because when the global default gateway is changed to the gateway of the vlan, it works so the problem was not in the vlan / lagg(4) setup.
 
Last edited by a moderator:
You must log in or register to reply here.
Back
Top