Pool and share usage reset to zero after either my upgrade to 3.8-14 or after a scrub and rebalance?

Bugs
1

I read the thread about Usage data on pools and shares not updated but my data was showing properly in the GUI. My problems started either after my upgrade to 3.8-14 OR after I did a Scrub and the balance.

GUI shows zero usage on my pool and shares except for a share that I have creaated AFTER this issue arised.

Command line shows proper usage of my pool with approx 2.4TB:
Command “btrfs fi show” generates the following output:

Label: ‘rockstor_rockstor’ uuid: ed1929a7-8cb8-4c9e-bf30-e51d39995d32
Total devices 1 FS bytes used 2.20GiB
devid 1 size 5.59GiB used 2.84GiB path /dev/md125

Label: ‘crazytank’ uuid: 4eca0d17-e444-4b92-8faa-522b9c1c09b0
Total devices 8 FS bytes used 2.40TiB
devid 1 size 3.64TiB used 412.70GiB path /dev/sda
devid 2 size 3.64TiB used 412.70GiB path /dev/sdb
devid 3 size 3.64TiB used 412.70GiB path /dev/sdc
devid 4 size 3.64TiB used 412.70GiB path /dev/sdd
devid 5 size 3.64TiB used 412.70GiB path /dev/sde
devid 6 size 3.64TiB used 412.70GiB path /dev/sdf
devid 7 size 3.64TiB used 412.70GiB path /dev/sdg
devid 8 size 3.64TiB used 412.70GiB path /dev/sdh

Command “df -h” generates the following output:

Filesystem Size Used Avail Use% Mounted on
devtmpfs 7.9G 0 7.9G 0% /dev
tmpfs 7.9G 0 7.9G 0% /dev/shm
tmpfs 7.9G 8.7M 7.9G 1% /run
tmpfs 7.9G 0 7.9G 0% /sys/fs/cgroup
/dev/md125 5.6G 2.4G 3.0G 45% /
/dev/md125 5.6G 2.4G 3.0G 45% /home
/dev/md126 5.4G 184M 5.0G 4% /boot
/dev/sda 30T 2.5T 26T 9% /mnt2/crazytank
/dev/md125 5.6G 2.4G 3.0G 45% /mnt2/rockstor_rockstor
/dev/sda 30T 2.5T 26T 9% /mnt2/videos
/dev/sda 30T 2.5T 26T 9% /mnt2/pictures
/dev/sda 30T 2.5T 26T 9% /mnt2/rockon
/dev/sda 30T 2.5T 26T 9% /mnt2/juha_main
/dev/sda 30T 2.5T 26T 9% /mnt2/movies
/dev/sda 30T 2.5T 26T 9% /mnt2/mobiledevicebackups
/dev/sda 30T 2.5T 26T 9% /mnt2/music
/dev/sda 30T 2.5T 26T 9% /mnt2/juhas
tmpfs 1.6G 0 1.6G 0% /run/user/0

While the GUI shows zero usage except for the two shares that I created after the problem started:

Pasted image337×612 16.2 KB

2

I have rebooted RockStor several times and cleared the cache of both my Firefox and Chrome browser but still no update.

I then looked in the rockstor.log to see what happens during the startup process after a reboot and I see some errors during the startup:

[29/Jun/2016 13:52:00] DEBUG [smart_manager.data_collector:682] Listening on port http://127.0.0.1:8080 and on port 10843 (flash policy server)
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:75] Exception while refreshing state for Pool(rockstor_rockstor). Moving on: Error running a command. cmd = [’/sbin/btrfs’, ‘fi’, ‘show’, ‘/dev/md127’]. rc = 1. stdout = [’’]. stderr = [‘ERROR: no btrfs on /dev/md127’, ‘’]
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:76] Error running a command. cmd = [’/sbin/btrfs’, ‘fi’, ‘show’, ‘/dev/md127’]. rc = 1. stdout = [’’]. stderr = [‘ERROR: no btrfs on /dev/md127’, ‘’]
Traceback (most recent call last):
File “/opt/rockstor/src/rockstor/storageadmin/views/command.py”, line 67, in _refresh_pool_state
pool_info = get_pool_info(fd.name)
File “/opt/rockstor/src/rockstor/fs/btrfs.py”, line 71, in get_pool_info
o, e, rc = run_command(cmd)
File “/opt/rockstor/src/rockstor/system/osi.py”, line 98, in run_command
raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = [’/sbin/btrfs’, ‘fi’, ‘show’, ‘/dev/md127’]. rc = 1. stdout = [’’]. stderr = [‘ERROR: no btrfs on /dev/md127’, ‘’]
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:97] Exception while mounting a share(home) during bootstrap: Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=home’, ‘/dev/md127’, ‘/mnt2/home’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/home busy’, ‘’]
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:98] Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=home’, ‘/dev/md127’, ‘/mnt2/home’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/home busy’, ‘’]
Traceback (most recent call last):
File “/opt/rockstor/src/rockstor/storageadmin/views/command.py”, line 93, in post
mount_share(share, mnt_pt)
File “/opt/rockstor/src/rockstor/fs/btrfs.py”, line 239, in mount_share
return run_command(mnt_cmd)
File “/opt/rockstor/src/rockstor/system/osi.py”, line 98, in run_command
raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=home’, ‘/dev/md127’, ‘/mnt2/home’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/home busy’, ‘’]
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:97] Exception while mounting a share(root00) during bootstrap: Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=root00’, ‘/dev/md127’, ‘/mnt2/root00’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/root00 busy’, ‘’]
[29/Jun/2016 13:52:03] ERROR [storageadmin.views.command:98] Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=root00’, ‘/dev/md127’, ‘/mnt2/root00’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/root00 busy’, ‘’]
Traceback (most recent call last):
File “/opt/rockstor/src/rockstor/storageadmin/views/command.py”, line 93, in post
mount_share(share, mnt_pt)
File “/opt/rockstor/src/rockstor/fs/btrfs.py”, line 239, in mount_share
return run_command(mnt_cmd)
File “/opt/rockstor/src/rockstor/system/osi.py”, line 98, in run_command
raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = [’/bin/mount’, ‘-t’, ‘btrfs’, ‘-o’, ‘subvol=root00’, ‘/dev/md127’, ‘/mnt2/root00’]. rc = 32. stdout = [’’]. stderr = [‘mount: /dev/md127 is already mounted or /mnt2/root00 busy’, ‘’]
[29/Jun/2016 13:52:04] DEBUG [storageadmin.views.command:152] Bootstrap operations completed

3

@CrazyFin I second your observation. Performed basically same order of tasks.

Have to check my logs at a later time though.

EDIT: see screenshot.

rockstor_share_usage_issue.png1716×353 27.2 KB

These shares:
media_audio 8.19 TB media_pool 0 bytes media_documents 8.19 TB media_pool 0 bytes media_graphics 8.19 TB media_pool 0 bytes media_video 8.19 TB media_pool 0 bytes

all existed before; then yesterday i created repo_pool using one disk taken from media_pool (intention was to re-distribute production batches of disks, i.e. avoid having a pool made from the same prod batch → usually considered a best practice), and a newly purchased one.

Swapped in another new disk for the removed, and re-balanced media_pool (as well as doing a regular scrub hours later but usage was zero already before the scrubbing).

btrfs fi show

[root@storageserver ~]# btrfs fi show
Label: 'rockstor_storageserver'  uuid: 5febd275-69b1-4d9f-9a17-2774c096e223
Total devices 1 FS bytes used 4.15GiB
devid    1 size 12.40GiB used 7.04GiB path /dev/sde3

Label: 'media_pool'  uuid: 3bb70b4d-7456-4ee3-8511-bb14e67dcb2d
        Total devices 2 FS bytes used 1.49TiB
        devid    1 size 5.46TiB used 1.49TiB path /dev/sdc
        devid    3 size 5.46TiB used 1.49TiB path /dev/sdd

Label: 'repo_pool'  uuid: 8bc44902-6437-47cd-b0f4-13c733de3f17
        Total devices 2 FS bytes used 791.16GiB
        devid    1 size 5.46TiB used 794.01GiB path /dev/sda
        devid    2 size 5.46TiB used 794.01GiB path /dev/sdb

In /opt/rockstor/var/log/rockstor.log i see only unrelated messages, but nothing for sda,sdb,sdc,sdd:
CommandException: Error running a command. cmd = ['/usr/sbin/smartctl', '--info', '/dev/nvme0n1']. rc = 1. stdout = ['smartctl 6.2 2013-07-26 r3841 [x86_64-linux-4.6.0-1.el7.elrepo.x86_64] (local build)', 'Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org', '', '/dev/nvme0n1: Unable to detect device type', 'Please specify device type with the -d option.', '', 'Use smartctl -h to get a usage summary', '', '']. stderr = [''] [01/Jul/2016 17:51:29] ERROR [storageadmin.views.disk:228] Error running a command. cmd = ['/usr/sbin/smartctl', '--info', '/dev/sde']. rc = 1. stdout = ['smartctl 6.2 2013-07-26 r3841 [x86_64-linux-4.6.0-1.el7.elrepo.x86_64] (local build)', 'Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org', '', '/dev/sde: Unknown USB bridge [0x0781:0x5581 (0x100)]', 'Please specify device type with the -d option.', '', 'Use smartctl -h to get a usage summary', '', '']. stderr = [''] Traceback (most recent call last): File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 226, in _update_disk_state do.name, do.smart_options) File "/opt/rockstor/src/rockstor/system/smart.py", line 311, in available [SMART, '--info'] + get_dev_options(device, custom_options)) File "/opt/rockstor/src/rockstor/system/osi.py", line 98, in run_command raise CommandException(cmd, out, err, rc) CommandException: Error running a command. cmd = ['/usr/sbin/smartctl', '--info', '/dev/sde']. rc = 1. stdout = ['smartctl 6.2 2013-07-26 r3841 [x86_64-linux-4.6.0-1.el7.elrepo.x86_64] (local build)', 'Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org', '', '/dev/sde: Unknown USB bridge [0x0781:0x5581 (0x100)]', 'Please specify device type with the -d option.', '', 'Use smartctl -h to get a usage summary', '', '']. stderr = [''] [01/Jul/2016 17:52:34] INFO [storageadmin.views.disk:83] Deleting duplicate or fake (by serial) Disk db entry. Serial = fake-serial-4c829a18-f9e4-461a-b428-25121d9b56b2 [01/Jul/2016 17:52:34] ERROR [storageadmin.views.disk:228] Error running a command. cmd = ['/usr/sbin/smartctl', '--info', '/dev/sde']. rc = 1. stdout = ['smartctl 6.2 2013-07-26 r3841 [x86_64-linux-4.6.0-1.el7.elrepo.x86_64] (local build)', 'Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org', '', '/dev/sde: Unknown USB bridge [0x0781:0x5581 (0x100)]', 'Please specify device type with the -d option.', '', 'Use smartctl -h to get a usage summary', '', '']. stderr = [''] Traceback (most recent call last): File "/opt/rockstor/src/rockstor/storageadmin/views/disk.py", line 226, in _update_disk_state do.name, do.smart_options) File "/opt/rockstor/src/rockstor/system/smart.py", line 311, in available [SMART, '--info'] + get_dev_options(device, custom_options)) File "/opt/rockstor/src/rockstor/system/osi.py", line 98, in run_command raise CommandException(cmd, out, err, rc)