VTd passthru of LSI2008 HBA not detecting disks in 3.8-10 Rockstor release

The saga continues for me, I stepped away from this for a bit once i realized I rebooted and issues popped up again. I have now been able to re-produce exactly what happens. After initial install/first boot i can see disks and mpt2sas driver/msg in dmesg look happy. If I simply reboot i can then no longer see disks and mpt2sas looks unhappy again.

See images. SMH

Drum roll…wait for it…and the fix for me was:

mpt2sas.msix_disable=1 (for 4.3 or older kernels)
mpt3sas.msix_disable=1 (for 4.4 or newer kernels)

Added to kernel boot line parameters, adding here as well for prosperity’s sake.

Under ubuntu or CentOS using grub2 to make it stick edit the /etc/default/grub to the following:

(mpt3sas.msix_disable=1 for 4.4 or newer kernels)

Save file:

Then update grub2 files:

Ubuntu - update-grub
CentOS - grub2-mkconfig -o /boot/grub2/grub.cfg (BIOS based machines)
grub2-mkconfig -o /boot/efi/EFI/redhat/grub.cfg (UEFI based machines)