Disk Scan errors expected string or buffer

kingwavy · May 14, 2018, 4:21am

Brief description of the problem

Cant re-add disks to Rockstor GUI after reinstall. I have 10 disks in a Direct attach storage shelf (Dell MD1220) that will not re-scan into the gui. Getting the error pasted down below. I have 10 other disks in the same DAS and they are all fine and detected. When I do a “btrfs fi list” via cli, the pool shows up with all the correct disks. Just cant get it in the rockstor gui.

Label: ‘SCRATCH’ uuid: a90e6787-1c45-46d6-a2ba-41017a17c1d5
Total devices 10 FS bytes used 986.91GiB
devid 1 size 931.51GiB used 202.62GiB path /dev/sdah
devid 2 size 931.51GiB used 202.62GiB path /dev/sdag
devid 3 size 931.51GiB used 202.62GiB path /dev/sdac
devid 4 size 931.51GiB used 202.62GiB path /dev/sdai
devid 5 size 931.51GiB used 202.62GiB path /dev/sdab
devid 6 size 931.51GiB used 202.62GiB path /dev/sdaf
devid 7 size 931.51GiB used 202.62GiB path /dev/sdaa
devid 8 size 931.51GiB used 202.62GiB path /dev/sdx
devid 9 size 931.51GiB used 202.62GiB path /dev/sdw
devid 10 size 931.51GiB used 202.62GiB path /dev/sdz

Detailed step by step instructions to reproduce the problem

Scan for disks

Error Traceback provided on the Web-UI

        Traceback (most recent call last):

File “/opt/rockstor/src/rockstor/rest_framework_custom/generic_view.py”, line 41, in _handle_exception
yield
File “/opt/rockstor/src/rockstor/storageadmin/views/disk.py”, line 377, in post
return self._update_disk_state()
File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py”, line 145, in inner
return func(*args, **kwargs)
File “/opt/rockstor/src/rockstor/storageadmin/views/disk.py”, line 342, in _update_disk_state
if (re.match(‘fake-serial-’, do.serial) is not None) or (
File “/usr/lib64/python2.7/re.py”, line 137, in match
return _compile(pattern, flags).match(string)
TypeError: expected string or buffer

phillxnet · May 14, 2018, 7:35pm

@kingwavy Welcome to the Rockstor community and thanks for your report.

We have seen this before (rarely) but have yet to track it down. Looks like you have a reproducer system so hopefully we can make some headway.

Do I assume that you have had this exact same hardware working successfully on a previous install?

Also could you report the version of Rockstor you are using, and upgrade to the latest if possible:

yum update rockstor

Essentially, as per:

our do.serial (disk object serial component) is not being set correctly, which is strange; and is required for proper Rockstor function.

Could you also post the output of the following commands:

btrfs fi show

and

ls -la /dev/disk/by-id/

and

lsblk -P -o NAME,MODEL,SERIAL,SIZE,TRAN,VENDOR,HCTL,TYPE,FSTYPE,LABEL,UUID

and when the above command has a serial entry such as:

SERIAL=""

we resource udev via:

github.com

rockstor/rockstor-core/blob/master/src/rockstor/system/osi.py#L418-L422


# First try harder with udev if lsblk failed on serial retrieval.
if (dmap['SERIAL'] == '' or always_use_udev_serial):
    # lsblk fails to retrieve SERIAL from VirtIO drives and some
    # sdcard devices and md devices so try specialized function.
    dmap['SERIAL'] = get_disk_serial(dmap['NAME'], dmap['TYPE'])

get_disk_serial location:

github.com

rockstor/rockstor-core/blob/master/src/rockstor/system/osi.py#L1012-L1017


def get_disk_serial(device_name, device_type=None, test=None):
"""Returns the serial number of device_name using udevadm to match that
returned by lsblk. N.B. udevadm has been observed to return the following:-
ID_SCSI_SERIAL  rarely seen
ID_SERIAL_SHORT  often seen
ID_SERIAL        thought to always be seen (see note below)

which in turn parses the following command. If you could execute this command on one of the drives that is showing the above empty serial (if any) it may help track this bug down:

udevadm info --name=devname-here

Also if you could remove the “#” and following space in front of the following line on your installed version located here:

/opt/rockstor/src/rockstor/system/osi.py

github.com

rockstor/rockstor-core/blob/master/src/rockstor/system/osi.py#L484


        dnames[dmap['NAME']] = [dmap['NAME'], dmap['MODEL'],
                                dmap['SERIAL'], dmap['SIZE'],
                                dmap['TRAN'], dmap['VENDOR'],
                                dmap['HCTL'], dmap['TYPE'],
                                dmap['FSTYPE'], dmap['LABEL'],
                                dmap['UUID'], dmap['parted'],
                                dmap['root'], dmap['partitions'], ]
# Transfer our collected disk / dev entries of interest to the disks list.
for d in dnames.keys():
    disks.append(Disk(*dnames[d]))
    # logger.debug('disks item = %s ', Disk(*dnames[d]))
return disks




def uptime():
with open('/proc/uptime') as ufo:
    # TODO: check on readline here as reads a character at a time
    # TODO: xreadlines() reads one line at a time.
    return int(float(ufo.readline().split()[0]))

and then enable debug logging via:

/opt/rockstor/bin/debug-mode on

Then either reboot or restart the rockstor service via:

systemctl restart rockstor

We should then be able to see in your logs what scan_disks() is passing to _update_disk_state() that is throwing it. Look in the main rockstor log for debug stuff, either via the UI component in System - Log Manager, or in:

/opt/rockstor/var/log/rockstor.log

We haven’t had an issue this this code for quite some time now so it would be good to get this one sorted.

A picture of your existing Disks page may also be helpful, just to see what this code has managed to pick up on.

Thanks for your assistance in this matter and lets hope we can track this one down.

kingwavy · May 15, 2018, 1:03am

Hey Philip,

This hardware was working on the previous install yes.

Version: 3.9.1-0

Ran yum update rockstor

Loading mirror speeds from cached hostfile
* base: mirrors.cmich.edu
* epel: mirror.steadfast.net
* extras: mirror.steadfast.net
* updates: mirror.rackspace.com
No packages marked for update
No update

Btrfs fi show:

[root@msp01-rockstor01p ~]# btrfs fi show
Label: 'rockstor_rockstor'  uuid: 7f7acdd7-493e-4bb5-b801-b7b7dc289535
Total devices 1 FS bytes used 1.59GiB
devid  1 size 264.63GiB used 4.06GiB path /dev/sda3
  
Label: 'SCRATCH'  uuid: a90e6787-1c45-46d6-a2ba-41017a17c1d5
Total devices 10 FS bytes used 986.91GiB
devid  1 size 931.51GiB used 202.62GiB path /dev/sdah
devid  2 size 931.51GiB used 202.62GiB path /dev/sdag
devid  3 size 931.51GiB used 202.62GiB path /dev/sdac
devid  4 size 931.51GiB used 202.62GiB path /dev/sdai
devid  5 size 931.51GiB used 202.62GiB path /dev/sdab
devid  6 size 931.51GiB used 202.62GiB path /dev/sdaf
devid  7 size 931.51GiB used 202.62GiB path /dev/sdaa
devid  8 size 931.51GiB used 202.62GiB path /dev/sdx
devid  9 size 931.51GiB used 202.62GiB path /dev/sdw
devid 10 size 931.51GiB used 202.62GiB path /dev/sdz

Label: 'Test'  uuid: 612f1fc2-dfa8-4940-a1ad-e11c893b32ca
Total devices 4 FS bytes used 2.14MiB
devid  1 size 558.38GiB used 2.00GiB path /dev/sdb
devid  2 size 558.38GiB used 2.00GiB path /dev/sdd
devid  3 size 558.38GiB used 2.00GiB path /dev/sde
devid  4 size 558.38GiB used 2.00GiB path /dev/sdh

Label: 'INTEL_SSD'  uuid: a504bf03-0299-4648-8a95-c91aba291de8
Total devices 3 FS bytes used 2.43MiB
devid  1 size 223.57GiB used 3.00GiB path /dev/sdae
devid  2 size 223.57GiB used 3.00GiB path /dev/sdaj
devid  3 size 223.57GiB used 3.00GiB path /dev/sdad

Label: 'BIGDATA'  uuid: cb15142f-9d1e-4cb2-9b1f-adda3af6555f
Total devices 6 FS bytes used 4.79TiB
devid  1 size 7.28TiB used 2.34TiB path /dev/sdi
devid  2 size 7.28TiB used 2.34TiB path /dev/sdf
devid  3 size 7.28TiB used 2.34TiB path /dev/sdk
devid  4 size 7.28TiB used 2.34TiB path /dev/sdm
devid  5 size 7.28TiB used 2.34TiB path /dev/sdc
devid  6 size 7.28TiB used 2.34TiB path /dev/sdg

Label: 'VMWARE_MECH_ARRAY'  uuid: e6d13c0b-825f-4b43-81b6-7eb2b791b1c3
Total devices 1 FS bytes used 12.77GiB
devid  1 size 2.72TiB used 33.02GiB path /dev/sdj

Label: '5TBWDGREEN'  uuid: a37956a8-a175-4906-82c1-bf843132da1a
Total devices 1 FS bytes used 15.94GiB
devid  1 size 4.55TiB used 18.02GiB path /dev/sdl

Label: 'MD1220-DAS'  uuid: 12d76eb6-7aad-46ba-863e-d9c51e8e6f2d
Total devices 10 FS bytes used 1.33TiB
devid  1 size 1.09TiB used 315.03GiB path /dev/sdn
devid  2 size 1.09TiB used 315.03GiB path /dev/sds
devid  3 size 1.09TiB used 315.03GiB path /dev/sdp
devid  4 size 1.09TiB used 315.03GiB path /dev/sdr
devid  5 size 1.09TiB used 315.03GiB path /dev/sdv
devid  6 size 1.09TiB used 315.03GiB path /dev/sdo
devid  7 size 1.09TiB used 315.03GiB path /dev/sdt
devid  8 size 1.09TiB used 315.03GiB path /dev/sdu
devid  9 size 1.09TiB used 315.03GiB path /dev/sdy
devid 10 size 1.09TiB used 315.03GiB path /dev/sdq

[root@msp01-rockstor01p ~]# ls -la /dev/disk/by-id/
total 0
drwxr-xr-x 2 root root 1600 May 14 01:02 .
drwxr-xr-x 6 root root  120 May 14 01:02 ..
lrwxrwxrwx 1 root root 10 May 14 01:02 ata-INTEL_SSDSC2KW240H6_CVLT6153072G240CGN -> ../../sdae
lrwxrwxrwx 1 root root 10 May 14 01:02 ata-INTEL_SSDSC2KW240H6_CVLT6181019S240CGN -> ../../sdaj
lrwxrwxrwx 1 root root 10 May 14 01:02 ata-INTEL_SSDSC2KW240H6_CVLT618101SE240CGN -> ../../sdad
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c50062cb366f -> ../../sdah
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c50062cbc1f3 -> ../../sdag
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c500630249cb -> ../../sdac
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c5006303ea0f -> ../../sdai
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c50063041947 -> ../../sdab
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c500630425df -> ../../sdaf
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c50063044363 -> ../../sdaa
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000c50063044387 -> ../../sdx
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000c500630450a3 -> ../../sdw
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000c5006304544b -> ../../sdz
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d2144ac -> ../../sdn
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d217968 -> ../../sds
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d21885c -> ../../sdp
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d2188e0 -> ../../sdr
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d21893c -> ../../sdv
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d21bc10 -> ../../sdo
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d273a24 -> ../../sdu
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d2766c0 -> ../../sdy
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d29f384 -> ../../sdq
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-35000cca01d2af91c -> ../../sdt
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450018b7c3a11330997b -> ../../sda
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-36848f690e936450018b7c3a11330997b-part1 -> ../../sda1
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-36848f690e936450018b7c3a11330997b-part2 -> ../../sda2
lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-36848f690e936450018b7c3a11330997b-part3 -> ../../sda3
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e9364500219f339b1610b547 -> ../../sdb
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e9364500219f33b21773ea22 -> ../../sdd
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e9364500219f33bb17fe7d7b -> ../../sde
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e9364500219f33d919c7488a -> ../../sdh
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021a4525005828671 -> ../../sdl
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021a4585b05e46fcc -> ../../sdf
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021a4586906bd9742 -> ../../sdi
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021a45f9904046a2f -> ../../sdj
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021acd1e705b389c6 -> ../../sdk
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021acd1f30663b877 -> ../../sdm
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021ed614a077c1b44 -> ../../sdc
lrwxrwxrwx 1 root root  9 May 14 01:02 scsi-36848f690e936450021ed61830ae57fbf -> ../../sdg
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c50062cb366f -> ../../sdah
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c50062cbc1f3 -> ../../sdag
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c500630249cb -> ../../sdac
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c5006303ea0f -> ../../sdai
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c50063041947 -> ../../sdab
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c500630425df -> ../../sdaf
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x5000c50063044363 -> ../../sdaa
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000c50063044387 -> ../../sdx
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000c500630450a3 -> ../../sdw
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000c5006304544b -> ../../sdz
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d2144ac -> ../../sdn
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d217968 -> ../../sds
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d21885c -> ../../sdp
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d2188e0 -> ../../sdr
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d21893c -> ../../sdv
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d21bc10 -> ../../sdo
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d273a24 -> ../../sdu
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d2766c0 -> ../../sdy
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d29f384 -> ../../sdq
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x5000cca01d2af91c -> ../../sdt
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x55cd2e414cb92e13 -> ../../sdae
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x55cd2e414cbd4bbf -> ../../sdaj
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x55cd2e414cbd4e54 -> ../../sdad
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450018b7c3a11330997b -> ../../sda
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x6848f690e936450018b7c3a11330997b-part1 -> ../../sda1
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x6848f690e936450018b7c3a11330997b-part2 -> ../../sda2
lrwxrwxrwx 1 root root 10 May 14 01:02 wwn-0x6848f690e936450018b7c3a11330997b-part3 -> ../../sda3
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e9364500219f339b1610b547 -> ../../sdb
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e9364500219f33b21773ea22 -> ../../sdd
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e9364500219f33bb17fe7d7b -> ../../sde
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e9364500219f33d919c7488a -> ../../sdh
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021a4525005828671 -> ../../sdl
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021a4585b05e46fcc -> ../../sdf
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021a4586906bd9742 -> ../../sdi
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021a45f9904046a2f -> ../../sdj
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021acd1e705b389c6 -> ../../sdk
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021acd1f30663b877 -> ../../sdm
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021ed614a077c1b44 -> ../../sdc
lrwxrwxrwx 1 root root  9 May 14 01:02 wwn-0x6848f690e936450021ed61830ae57fbf -> ../../sdg


 [root@msp01-rockstor01p ~]# lsblk -P -o NAME,MODEL,SERIAL,SIZE,TRAN,VENDOR,HCTL,TYPE,FSTYPE,LABEL,UUID

NAME="sdy" MODEL="HUC101212CSS600 " SERIAL="5000cca01d2766c0" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:11:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdf" MODEL="PERC H710 " SERIAL="6848f690e936450021a4585b05e46fcc" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:5:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sdab" MODEL="ST91000640SS  " SERIAL="5000c50063041947" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:14:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdo" MODEL="HUC101212CSS600 " SERIAL="5000cca01d21bc10" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:1:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdw" MODEL="ST91000640SS  " SERIAL="5000c500630450a3" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:9:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdd" MODEL="PERC H710 " SERIAL="6848f690e9364500219f33b21773ea22" SIZE="558.4G" TRAN="" VENDOR="DELL  " HCTL="0:2:3:0" TYPE="disk" FSTYPE="btrfs" LABEL="Test" UUID="612f1fc2-dfa8-4940-a1ad-e11c893b32ca"
NAME="sdm" MODEL="PERC H710 " SERIAL="6848f690e936450021acd1f30663b877" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:12:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sdu" MODEL="HUC101212CSS600 " SERIAL="5000cca01d273a24" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:7:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdai" MODEL="ST91000640SS  " SERIAL="5000c5006303ea0f" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:21:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdb" MODEL="PERC H710 " SERIAL="6848f690e9364500219f339b1610b547" SIZE="558.4G" TRAN="" VENDOR="DELL  " HCTL="0:2:1:0" TYPE="disk" FSTYPE="btrfs" LABEL="Test" UUID="612f1fc2-dfa8-4940-a1ad-e11c893b32ca"
NAME="sdk" MODEL="PERC H710 " SERIAL="6848f690e936450021acd1e705b389c6" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:10:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sds" MODEL="HUC101212CSS600 " SERIAL="5000cca01d217968" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:5:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdag" MODEL="ST91000640SS  " SERIAL="5000c50062cbc1f3" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:19:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdi" MODEL="PERC H710 " SERIAL="6848f690e936450021a4586906bd9742" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:8:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sdq" MODEL="HUC101212CSS600 " SERIAL="5000cca01d29f384" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:3:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdae" MODEL="INTEL SSDSC2KW24" SERIAL="CVLT6153072G240CGN" SIZE="223.6G" TRAN="sas" VENDOR="ATA " HCTL="1:0:17:0" TYPE="disk" FSTYPE="btrfs" LABEL="INTEL_SSD" UUID="a504bf03-0299-4648-8a95-c91aba291de8"
NAME="sdz" MODEL="ST91000640SS  " SERIAL="5000c5006304544b" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:12:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdg" MODEL="PERC H710 " SERIAL="6848f690e936450021ed61830ae57fbf" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:6:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sdac" MODEL="ST91000640SS  " SERIAL="5000c500630249cb" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:15:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdx" MODEL="ST91000640SS  " SERIAL="5000c50063044387" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:10:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sde" MODEL="PERC H710 " SERIAL="6848f690e9364500219f33bb17fe7d7b" SIZE="558.4G" TRAN="" VENDOR="DELL  " HCTL="0:2:4:0" TYPE="disk" FSTYPE="btrfs" LABEL="Test" UUID="612f1fc2-dfa8-4940-a1ad-e11c893b32ca"
NAME="sdaa" MODEL="ST91000640SS  " SERIAL="5000c50063044363" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:13:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdn" MODEL="HUC101212CSS600 " SERIAL="5000cca01d2144ac" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:0:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdv" MODEL="HUC101212CSS600 " SERIAL="5000cca01d21893c" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:8:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdaj" MODEL="INTEL SSDSC2KW24" SERIAL="CVLT6181019S240CGN" SIZE="223.6G" TRAN="sas" VENDOR="ATA " HCTL="1:0:22:0" TYPE="disk" FSTYPE="btrfs" LABEL="INTEL_SSD" UUID="a504bf03-0299-4648-8a95-c91aba291de8"
NAME="sdc" MODEL="PERC H710 " SERIAL="6848f690e936450021ed614a077c1b44" SIZE="7.3T" TRAN="" VENDOR="DELL  " HCTL="0:2:2:0" TYPE="disk" FSTYPE="btrfs" LABEL="BIGDATA" UUID="cb15142f-9d1e-4cb2-9b1f-adda3af6555f"
NAME="sdl" MODEL="PERC H710 " SERIAL="6848f690e936450021a4525005828671" SIZE="4.6T" TRAN="" VENDOR="DELL  " HCTL="0:2:11:0" TYPE="disk" FSTYPE="btrfs" LABEL="5TBWDGREEN" UUID="a37956a8-a175-4906-82c1-bf843132da1a"
NAME="sdt" MODEL="HUC101212CSS600 " SERIAL="5000cca01d2af91c" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:6:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdah" MODEL="ST91000640SS  " SERIAL="5000c50062cb366f" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:20:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sda" MODEL="PERC H710 " SERIAL="6848f690e936450018b7c3a11330997b" SIZE="278.9G" TRAN="" VENDOR="DELL  " HCTL="0:2:0:0" TYPE="disk" FSTYPE="" LABEL="" UUID=""
NAME="sda2" MODEL="" SERIAL="" SIZE="13.8G" TRAN="" VENDOR="" HCTL="" TYPE="part" FSTYPE="swap" LABEL="" UUID="a34b82d0-c342-41e0-a58d-4f0a0027829d"
NAME="sda3" MODEL="" SERIAL="" SIZE="264.7G" TRAN="" VENDOR="" HCTL="" TYPE="part" FSTYPE="btrfs" LABEL="rockstor_rockstor" UUID="7f7acdd7-493e-4bb5-b801-b7b7dc289535"
NAME="sda1" MODEL="" SERIAL="" SIZE="500M" TRAN="" VENDOR="" HCTL="" TYPE="part" FSTYPE="ext4" LABEL="" UUID="5d2848ff-ae8f-4c2f-b825-90621076acc1"
NAME="sdj" MODEL="PERC H710 " SERIAL="6848f690e936450021a45f9904046a2f" SIZE="2.7T" TRAN="" VENDOR="DELL  " HCTL="0:2:9:0" TYPE="disk" FSTYPE="btrfs" LABEL="VMWARE_MECH_ARRAY" UUID="e6d13c0b-825f-4b43-81b6-7eb2b791b1c3"
NAME="sdr" MODEL="HUC101212CSS600 " SERIAL="5000cca01d2188e0" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:4:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdaf" MODEL="ST91000640SS  " SERIAL="5000c500630425df" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:18:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"
NAME="sdh" MODEL="PERC H710 " SERIAL="6848f690e9364500219f33d919c7488a" SIZE="558.4G" TRAN="" VENDOR="DELL  " HCTL="0:2:7:0" TYPE="disk" FSTYPE="btrfs" LABEL="Test" UUID="612f1fc2-dfa8-4940-a1ad-e11c893b32ca"
NAME="sdp" MODEL="HUC101212CSS600 " SERIAL="5000cca01d21885c" SIZE="1.1T" TRAN="sas" VENDOR="HGST  " HCTL="1:0:2:0" TYPE="disk" FSTYPE="btrfs" LABEL="MD1220-DAS" UUID="12d76eb6-7aad-46ba-863e-d9c51e8e6f2d"
NAME="sdad" MODEL="INTEL SSDSC2KW24" SERIAL="CVLT618101SE240CGN" SIZE="223.6G" TRAN="sas" VENDOR="ATA " HCTL="1:0:16:0" TYPE="disk" FSTYPE="btrfs" LABEL="INTEL_SSD" UUID="a504bf03-0299-4648-8a95-c91aba291de8"

There doesn’t appear to be any drives that don’t have serials other than the Rockstor install drive.

Rockstor.log output is in post below. Hit the character limit on this post.

kingwavy · May 15, 2018, 1:04am

A good chunk of the rockstor.log

    Traceback (most recent call last):
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
        response = wrapped_callback(request, *callback_args, **callback_kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
        return view_func(*args, **kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
        return self.dispatch(request, *args, **kwargs)
      File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
        response = self.handle_exception(exc)
      File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
        response = handler(request, *args, **kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
        return func(*args, **kwargs)
      File "/opt/rockstor/src/rockstor/storageadmin/views/command.py", line 318, in post
        import_shares(p, request)
      File "/opt/rockstor/src/rockstor/storageadmin/views/share_helpers.py", line 83, in import_shares
        volume_usage(pool, share.qgroup, share.pqgroup)
      File "/opt/rockstor/src/rockstor/fs/btrfs.py", line 789, in volume_usage
        out, err, rc = run_command(cmd, log=True)
      File "/opt/rockstor/src/rockstor/system/osi.py", line 115, in run_command
        raise CommandException(cmd, out, err, rc)
    CommandException: Error running a command. cmd = /sbin/btrfs qgroup show /mnt2/MD1220-DAS/MD1220. rc = 1. stdout = ['']. stderr = ["ERROR: can't list qgroups: quotas not enabled", '']
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sda3', model='PERC H710', serial='6848f690e936450018b7c3a11330997b', size=277558067, transport=None, vendor='DELL', hctl='0:2:0:0', type='part', fstype='btrfs', label='rockstor_rockstor', uuid='7f7acdd7-493e-4bb5-b801-b7b7dc289535', parted=True, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdt', model='HUC101212CSS600', serial='5000cca01d2af91c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:6:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdu', model='HUC101212CSS600', serial='5000cca01d273a24', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:7:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdv', model='HUC101212CSS600', serial='5000cca01d21893c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:8:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdw', model='ST91000640SS', serial='5000c500630450a3', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:9:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdp', model='HUC101212CSS600', serial='5000cca01d21885c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:2:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdq', model='HUC101212CSS600', serial='5000cca01d29f384', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:3:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdr', model='HUC101212CSS600', serial='5000cca01d2188e0', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:4:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sds', model='HUC101212CSS600', serial='5000cca01d217968', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:5:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdx', model='ST91000640SS', serial='5000c50063044387', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:10:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdy', model='HUC101212CSS600', serial='5000cca01d2766c0', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:11:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdz', model='ST91000640SS', serial='5000c5006304544b', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:12:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdd', model='PERC H710', serial='6848f690e9364500219f33b21773ea22', size=585524838, transport=None, vendor='DELL', hctl='0:2:3:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sde', model='PERC H710', serial='6848f690e9364500219f33bb17fe7d7b', size=585524838, transport=None, vendor='DELL', hctl='0:2:4:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdf', model='PERC H710', serial='6848f690e936450021a4585b05e46fcc', size=7838315315, transport=None, vendor='DELL', hctl='0:2:5:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdg', model='PERC H710', serial='6848f690e936450021ed61830ae57fbf', size=7838315315, transport=None, vendor='DELL', hctl='0:2:6:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdb', model='PERC H710', serial='6848f690e9364500219f339b1610b547', size=585524838, transport=None, vendor='DELL', hctl='0:2:1:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdc', model='PERC H710', serial='6848f690e936450021ed614a077c1b44', size=7838315315, transport=None, vendor='DELL', hctl='0:2:2:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdl', model='PERC H710', serial='6848f690e936450021a4525005828671', size=4939212390, transport=None, vendor='DELL', hctl='0:2:11:0', type='disk', fstype='btrfs', label='5TBWDGREEN', uuid='a37956a8-a175-4906-82c1-bf843132da1a', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdm', model='PERC H710', serial='6848f690e936450021acd1f30663b877', size=7838315315, transport=None, vendor='DELL', hctl='0:2:12:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdn', model='HUC101212CSS600', serial='5000cca01d2144ac', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:0:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdo', model='HUC101212CSS600', serial='5000cca01d21bc10', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:1:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdh', model='PERC H710', serial='6848f690e9364500219f33d919c7488a', size=585524838, transport=None, vendor='DELL', hctl='0:2:7:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdi', model='PERC H710', serial='6848f690e936450021a4586906bd9742', size=7838315315, transport=None, vendor='DELL', hctl='0:2:8:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdj', model='PERC H710', serial='6848f690e936450021a45f9904046a2f', size=2899102924, transport=None, vendor='DELL', hctl='0:2:9:0', type='disk', fstype='btrfs', label='VMWARE_MECH_ARRAY', uuid='e6d13c0b-825f-4b43-81b6-7eb2b791b1c3', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdk', model='PERC H710', serial='6848f690e936450021acd1e705b389c6', size=7838315315, transport=None, vendor='DELL', hctl='0:2:10:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdaf', model='PERC H710', serial='fake-serial-77b9c3f8-7a3d-4add-9873-15c73ed56e27', size=976748544, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdag', model=None, serial='fake-serial-6fb0fd15-da47-4224-9ca9-d66bb64058e4', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdad', model='PERC H710', serial='fake-serial-92ed2454-1246-40ec-8566-1a7dcc6076c5', size=234461593, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdae', model=None, serial='fake-serial-ccae1c93-3df4-49e9-bc71-7c5e63849f85', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdab', model=None, serial=None, size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdac', model=None, serial='fake-serial-fc039240-4525-4786-bf72-66509c35ea29', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdaa', model=None, serial='fake-serial-988a17dd-fd58-4c74-9284-1594887c31db', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdaj', model=None, serial='fake-serial-dc53a2e1-84b0-445d-8f7e-1fc4dee8c343', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdah', model=None, serial='fake-serial-112c6bf6-d999-417a-bd95-0102742856e4', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:55] DEBUG [system.osi:478] disks item = Disk(name='sdai', model=None, serial='fake-serial-a9ab6c94-c75b-4d90-b11d-ddff7f67dc66', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:20:56] ERROR [storageadmin.util:44] exception: expected string or buffer
    Traceback (most recent call last):
      File "/opt/rockstor/src/rockstor/rest_framework_custom/generic_view.py", line 41, in _handle_exception
        yield
      File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 377, in post
        return self._update_disk_state()
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
        return func(*args, **kwargs)
      File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 342, in _update_disk_state
        if (re.match('fake-serial-', do.serial) is not None) or (
      File "/usr/lib64/python2.7/re.py", line 137, in match
        return _compile(pattern, flags).match(string)
    TypeError: expected string or buffer
    [14/May/2018 13:20:56] DEBUG [storageadmin.util:45] Current Rockstor version: 3.9.1-0
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sda3', model='PERC H710', serial='6848f690e936450018b7c3a11330997b', size=277558067, transport=None, vendor='DELL', hctl='0:2:0:0', type='part', fstype='btrfs', label='rockstor_rockstor', uuid='7f7acdd7-493e-4bb5-b801-b7b7dc289535', parted=True, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdt', model='HUC101212CSS600', serial='5000cca01d2af91c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:6:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdu', model='HUC101212CSS600', serial='5000cca01d273a24', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:7:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdv', model='HUC101212CSS600', serial='5000cca01d21893c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:8:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdw', model='ST91000640SS', serial='5000c500630450a3', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:9:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdp', model='HUC101212CSS600', serial='5000cca01d21885c', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:2:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdq', model='HUC101212CSS600', serial='5000cca01d29f384', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:3:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdr', model='HUC101212CSS600', serial='5000cca01d2188e0', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:4:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sds', model='HUC101212CSS600', serial='5000cca01d217968', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:5:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdx', model='ST91000640SS', serial='5000c50063044387', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:10:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdy', model='HUC101212CSS600', serial='5000cca01d2766c0', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:11:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdz', model='ST91000640SS', serial='5000c5006304544b', size=976748544, transport='sas', vendor='SEAGATE', hctl='1:0:12:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdd', model='PERC H710', serial='6848f690e9364500219f33b21773ea22', size=585524838, transport=None, vendor='DELL', hctl='0:2:3:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sde', model='PERC H710', serial='6848f690e9364500219f33bb17fe7d7b', size=585524838, transport=None, vendor='DELL', hctl='0:2:4:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdf', model='PERC H710', serial='6848f690e936450021a4585b05e46fcc', size=7838315315, transport=None, vendor='DELL', hctl='0:2:5:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdg', model='PERC H710', serial='6848f690e936450021ed61830ae57fbf', size=7838315315, transport=None, vendor='DELL', hctl='0:2:6:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdb', model='PERC H710', serial='6848f690e9364500219f339b1610b547', size=585524838, transport=None, vendor='DELL', hctl='0:2:1:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdc', model='PERC H710', serial='6848f690e936450021ed614a077c1b44', size=7838315315, transport=None, vendor='DELL', hctl='0:2:2:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdl', model='PERC H710', serial='6848f690e936450021a4525005828671', size=4939212390, transport=None, vendor='DELL', hctl='0:2:11:0', type='disk', fstype='btrfs', label='5TBWDGREEN', uuid='a37956a8-a175-4906-82c1-bf843132da1a', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdm', model='PERC H710', serial='6848f690e936450021acd1f30663b877', size=7838315315, transport=None, vendor='DELL', hctl='0:2:12:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdn', model='HUC101212CSS600', serial='5000cca01d2144ac', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:0:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdo', model='HUC101212CSS600', serial='5000cca01d21bc10', size=1181116006, transport='sas', vendor='HGST', hctl='1:0:1:0', type='disk', fstype='btrfs', label='MD1220-DAS', uuid='12d76eb6-7aad-46ba-863e-d9c51e8e6f2d', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdh', model='PERC H710', serial='6848f690e9364500219f33d919c7488a', size=585524838, transport=None, vendor='DELL', hctl='0:2:7:0', type='disk', fstype='btrfs', label='Test', uuid='612f1fc2-dfa8-4940-a1ad-e11c893b32ca', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdi', model='PERC H710', serial='6848f690e936450021a4586906bd9742', size=7838315315, transport=None, vendor='DELL', hctl='0:2:8:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdj', model='PERC H710', serial='6848f690e936450021a45f9904046a2f', size=2899102924, transport=None, vendor='DELL', hctl='0:2:9:0', type='disk', fstype='btrfs', label='VMWARE_MECH_ARRAY', uuid='e6d13c0b-825f-4b43-81b6-7eb2b791b1c3', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdk', model='PERC H710', serial='6848f690e936450021acd1e705b389c6', size=7838315315, transport=None, vendor='DELL', hctl='0:2:10:0', type='disk', fstype='btrfs', label='BIGDATA', uuid='cb15142f-9d1e-4cb2-9b1f-adda3af6555f', parted=False, root=False, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdaf', model='PERC H710', serial='fake-serial-0b606a7b-c7fa-4cf0-9e7a-c8dcc70d4034', size=976748544, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdag', model=None, serial='fake-serial-2a01338a-d494-40ef-80d9-ba2888bfde5f', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdad', model='PERC H710', serial='fake-serial-84d6ede5-091d-452b-8ebd-ced7625184aa', size=234461593, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdae', model=None, serial='fake-serial-288f98c5-e108-4ca4-b1e0-fd4a791e7ea5', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdab', model=None, serial=None, size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdac', model=None, serial='fake-serial-09b57d88-eac0-42b6-b676-5eccd8f78535', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdaa', model=None, serial='fake-serial-23a3af4d-3c6f-4b9c-a9b2-47f22a0b3c9e', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdaj', model=None, serial='fake-serial-a8d06f68-fa9f-4e87-93dd-7ed785c5bdb2', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdah', model=None, serial='fake-serial-a7564264-de05-4bce-9d0c-54d480590936', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdai', model=None, serial='fake-serial-d6464bda-6974-4ef9-982e-15dfd87f4e39', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 
    [14/May/2018 13:21:22] ERROR [storageadmin.util:44] exception: expected string or buffer
    Traceback (most recent call last):
      File "/opt/rockstor/src/rockstor/rest_framework_custom/generic_view.py", line 41, in _handle_exception
        yield
      File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 377, in post
        return self._update_disk_state()
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
        return func(*args, **kwargs)
      File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 342, in _update_disk_state
        if (re.match('fake-serial-', do.serial) is not None) or (
      File "/usr/lib64/python2.7/re.py", line 137, in match
        return _compile(pattern, flags).match(string)
    TypeError: expected string or buffer
    [14/May/2018 13:21:22] DEBUG [storageadmin.util:45] Current Rockstor version: 3.9.1-0
    [14/May/2018 13:21:24] ERROR [system.osi:113] non-zero code(1) returned by command: ['/sbin/btrfs', 'qgroup', 'show', '/mnt2/MD1220-DAS/MD1220']. output: [''] error: ["ERROR: can't list qgroups: quotas not enabled", '']
    [14/May/2018 13:21:24] ERROR [storageadmin.middleware:32] Exception occured while processing a request. Path: /api/commands/refresh-share-state method: POST
    [14/May/2018 13:21:24] ERROR [storageadmin.middleware:33] Error running a command. cmd = /sbin/btrfs qgroup show /mnt2/MD1220-DAS/MD1220. rc = 1. stdout = ['']. stderr = ["ERROR: can't list qgroups: quotas not enabled", '']
    Traceback (most recent call last):
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
        response = wrapped_callback(request, *callback_args, **callback_kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
        return view_func(*args, **kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
        return self.dispatch(request, *args, **kwargs)
      File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
        response = self.handle_exception(exc)
      File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
        response = handler(request, *args, **kwargs)
      File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
        return func(*args, **kwargs)
      File "/opt/rockstor/src/rockstor/storageadmin/views/command.py", line 318, in post
        import_shares(p, request)
      File "/opt/rockstor/src/rockstor/storageadmin/views/share_helpers.py", line 83, in import_shares
        volume_usage(pool, share.qgroup, share.pqgroup)
      File "/opt/rockstor/src/rockstor/fs/btrfs.py", line 789, in volume_usage
        out, err, rc = run_command(cmd, log=True)
      File "/opt/rockstor/src/rockstor/system/osi.py", line 115, in run_command
        raise CommandException(cmd, out, err, rc)
    CommandException: Error running a command. cmd = /sbin/btrfs qgroup show /mnt2/MD1220-DAS/MD1220. rc = 1. stdout = ['']. stderr = ["ERROR: can't list qgroups: quotas not enabled", '']

phillxnet · May 15, 2018, 7:47pm

@kingwavy Thanks, these outputs are most usefull.

From the response that command gave it looks like you have yet to subscribe to either of the Update Channels. Once you have done this you should be offered a much newer version of Rockstor than you currently have. Although our testing channel is itself now a good few months behind the stable channel due to it no longer having rpm updates in the mean time. Either channel should give you much newer code though. Although there has only been one change that I can remember that would affect your situation and I don’t think it’s going to help. Either way it’s worth subscribing to one of those channels to get what ever is available.

I’ve had a quick look and I now think I know what is causing this rather peculiar serial issue. Essentially sdab is incorrectly being identified as the root drive when in fact it’s part of the scratch pool. And as a result it’s completely retrievable serial is being lost, ie:

lrwxrwxrwx 1 root root 10 May 14 01:02 scsi-35000c50063041947 -> ../../sdab

NAME="sdab" MODEL="ST91000640SS  " SERIAL="5000c50063041947" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:14:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5"

[14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdab', model=None, serial=None, size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={})

Note the “serial=None” which should never happen but is due I think to the confusion with the “sda” root device and some special historical considerations we exercise to try and represent this ‘partition’ as a regular whole drive; which use to be all we dealt with as we added partition capability much later on: and then only in a limited fashion.

Also note the “root=True” here: plainly wrong as the real root is correctly identified as:

[14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sda3', model='PERC H710', serial='6848f690e936450018b7c3a11330997b', size=277558067, transport=None, vendor='DELL', hctl='0:2:0:0', type='part', fstype='btrfs', label='rockstor_rockstor', uuid='7f7acdd7-493e-4bb5-b801-b7b7dc289535', parted=True, root=True, partitions={})

Another tell tail sign is all other drives starting with sda are also identified similarly:

[14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdaf', model='PERC H710', serial='fake-serial-0b606a7b-c7fa-4cf0-9e7a-c8dcc70d4034', size=976748544, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 

[14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdag', model=None, serial='fake-serial-2a01338a-d494-40ef-80d9-ba2888bfde5f', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) 

[14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdae', model=None, serial='fake-serial-288f98c5-e108-4ca4-b1e0-fd4a791e7ea5', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={})

etc.

That’s my initial take on it and I hope to take a look at this soon. But alas I do have a little bit of a back log so I may well not get to this quickly.

Thanks for you assistance and I look forward to finally sorting this one out (unless someone else beats me to it of course). I think it’s essentially a bit of naive code that confuses sdab (etc) with sda, and consequently triggers an inappropriate and failing serial treatment ultimately loosing the serial already retrieved. Initial guess so far anyway and may still be off the mark. Is also dependant on the list order I suspect.

Incidentally our latest stable release can handle disabled quotas and has a UI component to switch these per pool. Although the quota related errors you have there may just be due to the failing scan so that quotas never get enabled.

Thanks again for you help and I will try and take a look when next I can.

phillxnet · May 16, 2018, 9:03am

@kingwavy I’ve had another quick look at this and have created the following preliminary issue as a result:

github.com/rockstor/rockstor-core

disk serial=none or fake-serial re sda[a-z] dev names

opened 08:59AM - 16 May 18 UTC

closed 12:16PM - 16 Jul 18 UTC

phillxnet

Thanks to forum member kingwavy in the following form thread for highlighting th…is bug. On initial inspection of the reported data, drive names of the form sdab, sdac, when the same system has a system drive of the more common sda# type name, are being incorrectly identified as system drives. This is currently thought to be the trigger for an incompatible serial=none response from scan_disks() that is then surfaced by scan_disks() caller _update_disk_state(): ``` File “/opt/rockstor/src/rockstor/storageadmin/views/disk.py”, line 342, in _update_disk_state if (re.match(‘fake-serial-’, do.serial) is not None) or ( File “/usr/lib64/python2.7/re.py”, line 137, in match return _compile(pattern, flags).match(string) TypeError: expected string or buffer ``` With kingwavy's assistance the incorrect labelling of root was identified via debug logging thus: ``` m = Disk(name='sdaf', model='PERC H710', serial='fake-serial-0b606a7b-c7fa-4cf0-9e7a-c8dcc70d4034', size=976748544, transport=None, vendor='DELL', hctl='0:2:0:0', type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdag', model=None, serial='fake-serial-2a01338a-d494-40ef-80d9-ba2888bfde5f', size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdae', model=None, serial='fake-serial-288f98c5-e108-4ca4-b1e0-fd4a791e7ea5', size=234461593, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='INTEL_SSD', uuid='a504bf03-0299-4648-8a95-c91aba291de8', parted=False, root=True, partitions={}) ``` ie multiple additional "root=True" attributions and a suspected consequent erroneous 'fake-serial-...' attribution: ie relevant lsblk: NAME="sdae" MODEL="INTEL SSDSC2KW24" SERIAL="CVLT6153072G240CGN" SIZE="223.6G" TRAN="sas" VENDOR="ATA " HCTL="1:0:17:0" TYPE="disk" FSTYPE="btrfs" LABEL="INTEL_SSD" UUID="a504bf03-0299-4648-8a95-c91aba291de8" However the system drive in this trigger system is still identified correctly: ``` [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sda3', model='PERC H710', serial='6848f690e936450018b7c3a11330997b', size=277558067, transport=None, vendor='DELL', hctl='0:2:0:0', type='part', fstype='btrfs', label='rockstor_rockstor', uuid='7f7acdd7-493e-4bb5-b801-b7b7dc289535', parted=True, root=True, partitions={}) ``` It is noteworthy that the 'sdab' drive (presumably list order related) is the victim of _update_disk_state() bug with "serial=none": ``` [14/May/2018 13:21:21] DEBUG [system.osi:478] disks item = Disk(name='sdab', model=None, serial=None, size=976748544, transport=None, vendor=None, hctl=None, type='disk', fstype='btrfs', label='SCRATCH', uuid='a90e6787-1c45-46d6-a2ba-41017a17c1d5', parted=False, root=True, partitions={}) ``` when the serial is again plainly available (via default and initial lsblk call): ``` NAME="sdab" MODEL="ST91000640SS " SERIAL="5000c50063041947" SIZE="931.5G" TRAN="sas" VENDOR="SEAGATE " HCTL="1:0:14:0" TYPE="disk" FSTYPE="btrfs" LABEL="SCRATCH" UUID="a90e6787-1c45-46d6-a2ba-41017a17c1d5" ``` Also tangentially relevant is root_disk()'s inflexibility re matching only sda and not sdab type drive names, though this is not currently thought to be a trigger in this issue. Please reference / update the following forum thread with this issues progress / resolution: https://forum.rockstor.com/t/disk-scan-errors-expected-string-or-buffer/4783

I’ll update this forum thread as progress is made.

phillxnet · July 7, 2018, 6:19pm

@kingwavy Re:

I have now replicated your findings re single serial=none (/dev/sdab) plus multiple incorrect fake-serial attributions (other /dev/sda[a-z] members) and incorrect ‘root=True’ members (all /dev/sda[a-z] members) by creating a unit test using your submitted lsblk output and debug log info for your 36 disk setup.

So I can now move to creating a fix (at least as far as this issue is concerned). I will keep this thread posted on progress.

kingwavy · July 8, 2018, 9:55pm

That is awesome news. Thanks for the update.

phillxnet · July 11, 2018, 6:52pm

@kingwavy Thanks for the encouragement.

Another quick update, I’ve now submitted a fix / pull request that is awaiting review that should address your issue. On a quirky note it turns out that this erroneous behaviour depends on a number of things coming together in exactly the wrong way so it’s good to have finally gotten to the bottom of it. We now have a unit test that replicates your 36 drive system from the scan_disks() point of view which I used as the initial reproducer .

Thanks again for your assistance in the detailed report and your return to my requests re debug info, command output etc. I’ll update this thread upon the fix/code being reviewed:

github.com/rockstor/rockstor-core

disk serial=none or fake-serial re sda[a-z] dev names. Fixes #1925

rockstor:master ← phillxnet:1925_disk_serial=none_or_fake-serial_re_sda(a-z)_dev_names

opened 06:32PM - 11 Jul 18 UTC

phillxnet

+1088 -18

On systems with 27 or more disks named sd* where the system/root is also install…ed on sda ie sda3 and where the 27th and subsequent disks are named sdaa, sdab etc and are also btrfs formatted; a regex based serial propagation bug (from base device to partition) in scan_disks() resulted in the first listed (by lsblk) sda[a-z] device receiving a serial=none attribution and the second and all subsequent listed sda[a-z] devices receiving an erroneous fake-serial attribution. All affected devices would also have empty (or incorrectly inherited from sda) model, transport, vendor, and hctl attributions. This resulted in an inability for the system to update the disk state as the abstracted disk info from the corrupt parsing of attached disk state caused an exception: "TypeError: expected string or buffer". Note that all affected disks (sda[a-z]) were also miss attributed as root=True in the erroneous abstract data produced by scan_disks() Summary 1. Add scan_disks() test mode to enable repeatable fake-serial- tests. 2. Establish unit tests to reproduce the above issue, as reported (36 disk system) and as a minimum artificial drive subset. 3. Establish unit tests to identify current correct behaviour for system disk on LUKS, mdraid, and bios mdraid; as well as btrfs in partition and data disk on bios mdraid behaviour. 4. Fix overly broad regex to identify system disk partitions, if any: ie improve system disk partition match mechanism. 5. Fix system disk LUKS, mdraid, bios mdraid regressions as a result of (4). 6. Address pre-existing TODO: re mdraid info via model info on non system disks; as part of the fix for (5). Fixes #1925 and, by way of duplication: Fixes #1834 ("disk serial is null") @schakrava Ready for review. Testing: The reported issue was reproduced via unit testing based on the reporter's 36 disk system. An abstract of the minimum drive count thought to be able to reproduce the issue was also produced. Further unit tests were constructed for regression testing during the fix development. ``` ./bin/test --settings=test-settings -v 3 -p test_osi* ``` with the relevant scan_disks() related results, post pr, as follows: ``` ... test_scan_disks_27_plus_disks_regression_issue (system.tests.test_osi.OSITests) ... ok test_scan_disks_btrfs_in_partition (system.tests.test_osi.OSITests) ... ok test_scan_disks_dell_perk_h710_md1220_36_disks (system.tests.test_osi.OSITests) ... ok test_scan_disks_intel_bios_raid_data_disk (system.tests.test_osi.OSITests) ... ok test_scan_disks_intel_bios_raid_sys_disk (system.tests.test_osi.OSITests) ... ok test_scan_disks_luks_on_bcache (system.tests.test_osi.OSITests) ... ok test_scan_disks_luks_sys_disk (system.tests.test_osi.OSITests) ... ok test_scan_disks_mdraid_sys_disk (system.tests.test_osi.OSITests) ... ok ---------------------------------------------------------------------- Ran 11 tests in 0.020s OK ``` The Intel bios raid related unit tests were developed using appropriately configured hardware. And all bcache related test data (LUKS on bcache) assumed the udev rules detailed at: https://forum.rockstor.com/t/bcache-developers-notes/2762 Thanks to forum member kingwavy for their cooperation and their contributing the report and the command outputs used to construct the initial unit test reproducer.

If all is well this fix should find it’s way into a stable channel release soon.

Hope that helps.

phillxnet · July 17, 2018, 10:01am

@kingwavy Re:

The fix assisted by your report / command output / log returns in this thread is now included as of stable channel release 3.9.2-31.

Let us know how this goes and make sure to confirm the actual running version of your Rockstor instance via:

yum info rockstor

just in case your system is affected by our early chicken and egg bug re version number reporting.

Hope that helps and thanks again for your patience and assistance with this long standing and elusive >26 drive count issue that also depended upon a certain drive naming scheme and the trigger drives having a btrfs fs on them. My understanding is that an in place update should resolve the issue.