I've been running six VNET-enabled jails via iocage that I wanted to revert to shared IP, as I've had some system crashes that I suspect are related to VNET issues. (The iocage documentation describes VNET as experimental and prone to causing instability.)
After making the switch, the three jails with services that rely on avahi/multicast traffic for network announce and discovery of clients -- CUPS, Homebridge, and forked-daapd -- have stopped working, while the other jails are still working fine, which leads me to think something about the default shared IP jail config prevents avahi from working right. I've found a number of threads on this forum going back a solid decade (!!) asking about this issue but no one seems to have arrived at a definitive cause or solution.
Does anyone have any ideas? I'm relatively inexperienced with FreeBSD and even less so high-level networking, but figured my network config is the best place to start. Also tried enabling allow_raw_sockets on the affected jails with no change.
Host system with shared IP jails (the first IP ending .52 is the host, the others are jails):
Sample shared IP jail:
Sample VNET jail:
After making the switch, the three jails with services that rely on avahi/multicast traffic for network announce and discovery of clients -- CUPS, Homebridge, and forked-daapd -- have stopped working, while the other jails are still working fine, which leads me to think something about the default shared IP jail config prevents avahi from working right. I've found a number of threads on this forum going back a solid decade (!!) asking about this issue but no one seems to have arrived at a definitive cause or solution.
Does anyone have any ideas? I'm relatively inexperienced with FreeBSD and even less so high-level networking, but figured my network config is the best place to start. Also tried enabling allow_raw_sockets on the affected jails with no change.
Host system with shared IP jails (the first IP ending .52 is the host, the others are jails):
Code:
em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
ether 1c:b7:2c:af:91:35
hwaddr 1c:b7:2c:af:91:35
inet 192.168.1.52 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.98 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.99 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.92 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.175 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.219 netmask 0xffffff00 broadcast 192.168.1.255
inet 192.168.1.133 netmask 0xffffff00 broadcast 192.168.1.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 02:89:50:69:d9:00
nd6 options=1<PERFORMNUD>
groups: bridge
id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 1 priority 128 path cost 20000
Sample shared IP jail:
Code:
em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
ether 1c:b7:2c:af:91:35
hwaddr 1c:b7:2c:af:91:35
inet 192.168.1.133 netmask 0xffffff00 broadcast 192.168.1.255
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 02:89:50:69:d9:00
groups: bridge
id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 1 priority 128 path cost 20000
Sample VNET jail:
Code:
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
groups: lo
epair0b: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=8<VLAN_MTU>
ether 1c:b7:2c:bd:67:e6
hwaddr 02:d2:d0:00:05:0b
inet 192.168.1.219 netmask 0xffffff00 broadcast 192.168.1.255
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
groups: epair