Cisco UCS VIC 15427 Network Card under FreeBSD 14.2

[incin]

We have a server with a Cisco UCS VIC 15427 network card. These cards got FreeBSD support in 14.0 and the server I installed is on FreeBSD 14.2.

In the IPMI of the server there are a lot of options to configure but I kept things basic, I set the card in physical NIC mode and on the vNICs set them to vlan mode 'access' instead of trunk. See the screen shots attached.

Inside the server I get 128 enic devices that show up. In rc.conf I set my IP to enic0 and the interface is up and I can ping myself. I can not however, ping any other node on the same switch or my gateway. Physical cables and switch config is good.

When looking at ifconfig some of the enics "show carrier" which I would expect since only 2 physical NICs have a cable plugged in.

The media type for all of the enics is 10BaseFL but I would expect 10Gbase-SR and things are connected over fiber. I can not change and options for the interfaces either as I get a SIOCSIFMEDIA error.

Anyone else have issues with using this these cards and FreeBSD?

 

[incin]

enic0 matches is mac address with eth0 on the IPMI. Same for 1, 2, and 3.

enic4 has the same mac address as enic0, enic5 has the same mac as enic1, etc. This just repeats for all 128 enic devices.

 

[Phishfry]

We have a server with a Cisco UCS VIC 15427 network card.

Is this a Cisco Server? The model would help.

The DCE Interfaces are special correct? They are similar to trunk ports. They have a serial connection embedded and must pair with another DCE interface.
They also require special DCE cables.

Is this a mezzanine card or PCIe card?

 

[incin]

This card is in a UCS C220 M7S server. The card is a mLOM card.


Nothing really special about the DCE interfaces I think. Not much to configure on them, see new attached screenshot. The only special thing is the Cisco req SFP.

The eth interfaces you have a lot more option and have to put that vNIC into access mode in order to get it working on a Linux server.

The OS should only see 4 NICs since that is how many vNICs there are.

 

[Phishfry]

I think if I were trying to get that rig running I would be trying with -CURRENT or 15-PRE-RELEASE

This is new work in upcoming FreeBSD 15.0

dev/e6000sw(4) - FreeBSD Wiki

Put your description here.

wiki.freebsd.org

I would not be surprised if there were a ethernet switch chip involved here with the 128 enic intefaces showing.
Hard to tell if its Marvell based switch chip.

 

[Phishfry]

Have you taken a look at pciconf -lv ?
I am curious how you enic interfaces turn up there.

 

[incin]

The chip is specific to Cisco.

Yeah, pciconf screen shot in my first post has part of the list if you want to see it.