Solved Dell R430, R640, H730, freebsd-update and CAM error

R

richardtoohey2

Hi,

Taken a while to get this far, but wondering if anyone has seen anything like this and/or has some answers.

I've gone through a lot of machines, but the simple reproducible case is:

1) Dell R430 (or R640)
2) Dell H730 RAID controller
3) mrsas driver
4) old firmware or latest makes no difference
5) SSD or hard drives makes no difference
6) UEFI
7) UFS
8) RAID1 (but shows on machines with RAID5)

Clean install of amd64 FreeBSD 13.0-RELEASE. A clean install will put /dev/da0p1 in /etc/fstab mounted as /boot/efi

So I've installed 13.0-RELEASE and I want to upgrade.

Code: 
freebsd-update fetch
freebsd-update install

During the install of the kernel upgrades (and it only happens for kernel upgrades) I get a CAM error (see below).

I've seen this CAM error on three different Dell R430 machines, and one R640. The error messages, offsets, counts, etc. are the same on all machines.

I thought it was a bit quirky and have ignored for a while, until recently a machine had a panic and I needed to fsck to make it happy again.

This is the line in freebsd-update that causes the error:

Code: 
kldxref -R //boot/

It recurses through /boot. If I do this BEFORE I let the upgrade run - there's no error:

Code: 
umount /boot/efi

If I reboot the machine (leaving the /boot/efi mount in /etc/fstab) I can trigger the same error after the reboot, JUST by tickling the efi subdirectory:

Code: 
kldxref -vR //boot/efi

But it only happens once. To get the message again, I'll need to reboot.

My workaround is to umount the drive, and edit /etc/fstab to remove the mount-point (so that the next freebsd-update won't trigger the issue).

The error messages include this:

length=895488

... and the loader.efi file is 896000 bytes in size. Is that a coincidence?

Here is the error in action:

Code: 
root@r430:/home/xyz # kldxref -vR //boot/efi
//boot/efi/efi/Dell/BootOptionCache/BootOptionCache.dat
kldxref: elf_open(//boot/efi/efi/Dell/BootOptionCache/BootOptionCache.dat): Inappropriate file type or format
//boot/efi/efi/boot/bootx64.efi
kldxref: elf_open(//boot/efi/efi/boot/bootx64.efi): Inappropriate file type or format
//boot/efi/efi/freebsd/loader.efi
kldxref: elf_open(//boot/efi/efi/freebsd/loader.efi): Inappropriate file type or format 

Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 34 cf 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 34 cf 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 34 cf 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 34 cf 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 34 cf 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: g_vfs_done():da0p1[READ(offset=6901248, length=895488)]error = 
Mar 18 14:12:23 r430 kernel: 5
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 27 23 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 29 53 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 27 23 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 29 53 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 27 23 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 29 53 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 27 23 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 29 53 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 27 23 00 02 30 00 
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 29 53 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 2b 83 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 2b 83 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 2b 83 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 2b 83 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 18 14:12:23 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 18 14:12:23 r430 kernel: mrsas0: Data map/load failed.
Mar 18 14:12:23 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 2b 83 00 02 30 00 
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 18 14:12:23 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 18 14:12:23 r430 kernel: g_vfs_done():da0p1[READ(offset=5109248, length=895488)]error = 
Mar 18 14:12:23 r430 kernel: 5

root@r430:/home/xyz # gpart show
=>       40  936629936  da0  GPT  (447G)
         40     532480    1  efi  (260M)
     532520  928505848    2  freebsd-ufs  (443G)
  929038368    7591608    3  freebsd-swap  (3.6G)

root@r430:/home/xyz # mount
/dev/da0p2 on / (ufs, local, journaled soft-updates)
devfs on /dev (devfs)
/dev/da0p1 on /boot/efi (msdosfs, local)
root@r430:/home/xyz # ls -l /boot/efi/
total 1
drwxr-xr-x  1 root  wheel  512 Mar 18 11:37 efi
root@r430:/home/xyz # ls -l /boot/efi/efi/
total 2
drwxr-xr-x  1 root  wheel  512 Mar 18 11:40 Dell
drwxr-xr-x  1 root  wheel  512 Mar 18 11:37 boot
drwxr-xr-x  1 root  wheel  512 Mar 18 11:37 freebsd

On a Dell R430, H730, RAID, mrsas, etc. I do NOT see the error. That machine was on 12.X upgraded to 13.0, and neither 12.X or the 13.0 upgrade process put the line in /etc/fstab.
 
It's not freebsd-update or kldxref; after a reboot this code is enough to trigger it (roughly copied from ef.c in kldxref):
Code: 
#include <fcntl.h>
int main(void) {
char hdr[128];
int fd,res;
fd = open("//boot/efi/efi/boot/bootx64.efi", O_RDONLY);
res = read(fd, hdr, 64);
}

In another console - our friend is back:
Code: 
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 3 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 2 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 1 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Retrying command, 0 more tries remain
Mar 22 11:58:52 r430 kernel: mrsas0: mrsas_data_load_cb_prp: error=27
Mar 22 11:58:52 r430 kernel: mrsas0: Data map/load failed.
Mar 22 11:58:52 r430 kernel: mrsas0: Build RW LDIO failed.
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 36 ff 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): READ(10). CDB: 28 00 00 00 39 2f 00 02 30 00 
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): CAM status: SMP Status Error
Mar 22 11:58:52 r430 kernel: (da0:mrsas0:0:0:0): Error 5, Retries exhausted
Mar 22 11:58:52 r430 kernel: g_vfs_done():da0p1[READ(offset=6901248, length=895488)]error = 
Mar 22 11:58:52 r430 kernel: 5

But if I do a reboot, and something like:
Code: 
hexdump -C //boot/efi/efi/boot/bootx64.efi

The error is NOT triggered. Why not?!?

And after I've done that hexdump - the readit code does not trigger the error, but kldxref does (?).
 
But the good news is that it seems to be fixed in 13.1 - I've just done a clean install of BETA2 and gone through some testing steps and it seems a lot happier.
Code: 
$ ls -l /boot/efi/efi/freebsd/loader.efi 
-rwxr-xr-x  1 root  wheel  891904 Mar 22 13:47 /boot/efi/efi/freebsd/loader.efi

13.1 still makes that mount point, but the file size has changed (if that was anything to do with the issue).

Reboot, rebuild and run my readit test program - still looking good. So it looks as though something in 13.0 but that is fixed in 13.1 (or 13.1 doesn't tickle the faulting driver code for some reason.)

Hmmm, this looks like the sort of change:

⚙ D30798 aacraid: reduce max I/O size to avoid DMA issues

reviews.freebsd.org reviews.freebsd.org

Tested on a Talos II machine with an aacraid controller.
Without this change, newfs_msdos /dev/da0p1 had about 50% chance of failing.
This also happened in large writes and when kldxref was run after initial install.

Not the actual change because that was in aac.
 
You must log in or register to reply here.
Back
Top