bhyve VM-BHYVE no WAN access

pela0

pela0

Hi guys, I'm setting a new bhyve server, which is working flawlessly except for one machine not having access to internet, I can't figure out why...I'm using vm-bhyve for quite a while now with no problems at all.... I just can't understand why it's not working...

I have some VMs working fine, accessing the lan interface with no problems, so far so good:
Code: 
root@bhyve01:/bhyve/vms # vm list
NAME           DATASTORE  LOADER     CPU  MEMORY  VNC           AUTOSTART  STATE
DIM-2016VIRS4  default    uefi       2    12G     -             No         Stopped
DIM-2019VIRS4  default    uefi       4    8G      0.0.0.0:5900  Yes [1]    Running (16452)
DIM2019VIRS5   default    uefi       4    8G      0.0.0.0:5904  Yes [2]    Running (9807)
DIM2019VIRW1   default    uefi       2    8G      0.0.0.0:5901  Yes [3]    Running (11306)
DIM2019VIRW2   default    uefi       4    12G     0.0.0.0:5903  Yes [4]    Running (10574)
W2016          default    uefi       4    8G      -             No         Stopped
W2019          default    uefi       4    8G      -             No         Stopped
fbsd12         default    bhyveload  1    256M    -             No         Running (27371)

Got two switches, one to LAN, the other for WAN (is a server, no wlan here):

Code: 
root@bhyve01:/bhyve/vms # vm switch list
NAME     TYPE      IFACE       ADDRESS  PRIVATE  MTU  VLAN  PORTS
VLAN172  standard  vm-VLAN172  -        no       -    -     ixl0
public   standard  vm-public   -        no       -    -     ixl1

root@bhyve01:/bhyve/vms # vm switch info public
------------------------
Virtual Switch: public
------------------------
  type: standard
  ident: vm-public
  vlan: -
  physical-ports: ixl1
  bytes-in: 8876 (8.667K)
  bytes-out: 0 (0.000B)

  virtual-port
    device: tap5
    vm: fbsd12

The problematic host:

Code: 
root@test:~ # ifconfig 
vtnet0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=80028<VLAN_MTU,JUMBO_MTU,LINKSTATE>
        ether 58:9c:fc:05:1f:a6
        inet XXX.XX.XX.41 netmask 0xfffffff0 broadcast XXX.XX.XX.47
        media: Ethernet 10Gbase-T <full-duplex>
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
        inet 127.0.0.1 netmask 0xff000000
        groups: lo
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
root@test:~ # netstat -r
Routing tables

Internet:
Destination        Gateway            Flags     Netif Expire
default            XXX.XX.XX.33       UGS      vtnet0
localhost          link#2             UH          lo0
XXX.XX.XX.32/28    link#1             U        vtnet0
XXX.XX.XX.41       link#1             UHS         lo0

Internet6:
Destination        Gateway            Flags     Netif Expire
::/96              localhost          UGRS        lo0
localhost          link#2             UH          lo0
::ffff:0.0.0.0/96  localhost          UGRS        lo0
fe80::/10          localhost          UGRS        lo0
fe80::%lo0/64      link#2             U           lo0
fe80::1%lo0        link#2             UHS         lo0
ff02::/16          localhost          UGRS        lo0

A tcpdump -i tap5 shows:




Code: 
root@bhyve01:/bhyve/vms # tcpdump -vv -i tap5
tcpdump: listening on tap5, link-type EN10MB (Ethernet), capture size 262144 bytes
15:44:59.163879 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.41 tell XXX.XX.XX.41, length 28
15:45:57.998831 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:46:03.028689 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:46:05.128693 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:46:15.189645 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:46:20.229209 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:46:25.289682 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:00.481351 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.41 tell XXX.XX.XX.41, length 28
15:47:29.383165 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:30.396607 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:31.445930 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:32.518624 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:33.546030 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:34.618635 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:35.645751 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28
15:47:36.718644 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has XXX.XX.XX.33 tell XXX.XX.XX.41, length 28

It seems to me that the config has no problems, still have not even ping from inside. But, if I put the same IP (XXX.XX.XX.41), with no route to the IXL1 Iface...bam!! got network...which seems absolutely weird, none of the hosts (server and vm) complain about IP collision... I'm stuck... Can anyone point me in the right direction?

THANKS A BUNCH!!!

P.
 
You must log in or register to reply here.
Back
Top