Can not import a BTRFS Pool over Rockstor GUI

Klapaucius · September 9, 2021, 1:55pm

Hello dear community,
I have a problem mounting the existing BTRFS pool (RAID 10) via the Rockstor GUI after reinstall Rockstor. I always get the error message “Unknown internal error doing a POST to /api/disks/2/btrfs-disk-import” (screenshot 1).

The Rockstor install is a VM on a VmwareESXI Server with virtually mounted drivers (VMX edit: disk.EnableUUID=“true”) and all the 4 HDDs are functionally OK with no errors in SMART (screenshot 2)
https://drive.google.com/file/d/1tpHhV9b6nCtehtkCQIzkCmf4DuFbf9oY/view?usp=sharing

However, I have successfully mounted the pool via the console with btrfs commands and can also access the Pool data via SCP (screenshot 3).
https://drive.google.com/file/d/1aoFNh61Q4mvtI2sVMBOHHOlMx3uvAG3c/view?usp=sharing

In the Rockstor GUI, the pool is not integrated and I cannot manage it via the GUI (neither can I create new shares nor access the Rockons).

Is there any way to integrate the pool via the Rockstor GUI so that I can manage it via the GUI?

Thanks a lot for the help

Klapaucius · September 9, 2021, 2:09pm

My Rockstor version is: 4.0.8.0 on OpenSuse Leap 15 and kernel Linux: 5.3.18-lp152.87-default

journalctl says:

Sep 09 16:00:03 home-server systemd[1]: Started Timeline of Snapper Snapshots.
Sep 09 16:00:03 home-server dbus-daemon[736]: [system] Activating service name='org.opensuse.Snapper' requested by ':1.138' (uid=0 pid=29216 comm="/usr/lib/snapper/systemd-helper --timeline ") (using servicehelper)
Sep 09 16:00:03 home-server dbus-daemon[736]: [system] Successfully activated service 'org.opensuse.Snapper'

Klapaucius · September 9, 2021, 2:22pm

btrfs fi show says:
Screenshot_3

phillxnet · September 9, 2021, 3:40pm

@Klapaucius Welcome to the Rockstor community.

Re the import failure. Could you enable debug mode via the following executed as the root user:

/opt/rockstor/bin/debug-mode on

and try the import again with an excerpt from the following log:

/opt/rockstor/var/log/rockstor.log

at the time you tried to do the import. Also note that if you have previously used a very old version of Rockstor’s Web-UI then a refresh of the browser window can help as it is possible for older browser based code to be left over from an older v3 Web-UI version.

Also note that a reboot may help to clear things up and that an existing mount, if in the wrong location or mount point, can interfere with the import process. But your indicated mount point looks good thought.

Rockstor itself will always attempt to mount a pool at /mnt2/<pool-lavel-here>

so your by-hand mount looks OK if the pool label is “STORAGE-POOL” which it appears to be from your “btrfs fi show” command. And with some custom mount options a by-hand mount (including these options) can help with an import as you then circumvent the Web-UI’s doomed attempt to mount that pool with the non custom options (if they are required for mount).

Did you by chance also use say space_cache_v2 or anything like that with your prior Rockstor setup?

You just need a single initial pool import from any one of the pool’s disk members. Then Rockstor will treat the pool as managed by itself. And given it just attempts a fairly generic mount, and you have already achieved this mount we just need compare the differences. If you could paste, from the log entry of the failed import, the details of what Rockstor tries and also paste your own /mnt2/STORAGE-POOL mount there may be an important and required difference.

Also, have you tried the import from the Web-UI after your apparently successful mount. Note again that by-hand mounts can throw Rockstor’s import off if they are not what it was going to do anyway. I see many other mount points (dirs) in your /mnt2 for example. So a reboot and fresh run of the bare minimum is good. Rockstor should import any prior Rocksor pool without error if the given pool is healthy.

Lets see the log entry at the time of a failed import and take it from there. And best to do this after a reboot so the state of the system is cleaner. And record all that you do in attempting the import. If you’ve mounted it yourself successfully then we just need to see why Rockstor failed to do the same. Sometimes it can simply be a timeout as the first import can take too long for the Web-UI (but this is rare).

Hope that helps.

Klapaucius · September 9, 2021, 4:58pm

Many thanks for the answer and tipps.

First I restarted the Rockstor VM, deleted all cookies in the browser and logged in again.

Then I activated debug mode and tried to mount the pool about 5 times in the web GUI.
Here is the excerpt of the Rockstor.log

[09/Sep/2021 18:21:56] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:21:57] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:21:57] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:21:57] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:21:57] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:22:48] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs quota enable /mnt2/STORAGE-POOL
[09/Sep/2021 18:22:58] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:23:13] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = nextcloud-data.
[09/Sep/2021 18:23:13] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:23:13] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:23:37] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:23:37] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = CALIBRE-BOOKS.
[09/Sep/2021 18:23:37] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:23:37] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:24:01] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:24:01] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = WIRESHARK-DATA.
[09/Sep/2021 18:24:01] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:24:01] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:24:15] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:24:15] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:24:15] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:24:15] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:25:16] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:25:17] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:25:17] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:25:17] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:25:17] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:25:29] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs quota enable /mnt2/STORAGE-POOL
[09/Sep/2021 18:25:32] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = nextcloud-data.
[09/Sep/2021 18:25:32] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:25:32] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:25:56] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:25:56] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = CALIBRE-BOOKS.
[09/Sep/2021 18:25:56] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:25:56] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:26:17] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:26:19] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:26:19] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = WIRESHARK-DATA.
[09/Sep/2021 18:26:19] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:26:19] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:26:42] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:26:43] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = BITWARDEN-DATA.
[09/Sep/2021 18:26:43] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:26:43] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:27:06] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:27:06] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = ZONEMINDER-WEBCAM-CONFIG.
[09/Sep/2021 18:27:06] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:27:06] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:27:30] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:27:30] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:27:30] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:27:30] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:27:48] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs quota enable /mnt2/STORAGE-POOL
[09/Sep/2021 18:27:51] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = nextcloud-data.
[09/Sep/2021 18:27:51] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:27:51] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:28:15] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:28:15] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = CALIBRE-BOOKS.
[09/Sep/2021 18:28:15] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:28:15] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:28:30] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:28:38] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:28:38] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = WIRESHARK-DATA.
[09/Sep/2021 18:28:38] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:28:38] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:29:01] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:29:02] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = BITWARDEN-DATA.
[09/Sep/2021 18:29:02] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:29:02] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:29:25] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:29:25] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = ZONEMINDER-WEBCAM-CONFIG.
[09/Sep/2021 18:29:25] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:29:25] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:29:48] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:29:49] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:29:49] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:29:49] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:29:49] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:30:00] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs quota enable /mnt2/STORAGE-POOL
[09/Sep/2021 18:30:03] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = nextcloud-data.
[09/Sep/2021 18:30:03] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:30:03] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:30:27] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:30:27] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = CALIBRE-BOOKS.
[09/Sep/2021 18:30:27] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:30:27] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:30:49] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:30:51] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:30:51] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = WIRESHARK-DATA.
[09/Sep/2021 18:30:51] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:30:51] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:31:15] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:31:15] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = BITWARDEN-DATA.
[09/Sep/2021 18:31:15] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:31:15] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:31:39] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/STORAGE-POOL
[09/Sep/2021 18:31:39] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = ZONEMINDER-WEBCAM-CONFIG.
[09/Sep/2021 18:31:39] DEBUG [storageadmin.views.share_helpers:165] No prior entries in scanned pool trying all pools.
[09/Sep/2021 18:31:39] DEBUG [storageadmin.views.share_helpers:201] Db share entry does not exist - creating.
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:32:02] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:32:02] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:32:02] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:32:02] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:33:03] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:33:03] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:33:03] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:33:03] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:33:03] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:34:04] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:34:04] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:34:04] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:34:04] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:34:04] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT
[09/Sep/2021 18:35:04] DEBUG [system.osi:469] — Inheriting base_root_disk info —
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(@).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(.snapshots/1/snapshot).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(opt).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(root).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(srv).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(tmp).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(var).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(usr/local).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/i386-pc).
[09/Sep/2021 18:35:05] DEBUG [fs.btrfs:786] Skipping excluded subvol: name=(boot/grub2/x86_64-efi).
[09/Sep/2021 18:35:05] DEBUG [storageadmin.views.share_helpers:111] ---- Share name = home.
[09/Sep/2021 18:35:05] DEBUG [storageadmin.views.share_helpers:113] Updating pre-existing same pool db share entry.
[09/Sep/2021 18:35:05] DEBUG [system.osi:182] Running command: /usr/sbin/btrfs subvolume list /mnt2/ROOT

I noticed that BEFORE mounting the pool in /mnt2/ there were two directories, /ROOT and /home. Presumably they were created during the installation of Rockstor (ROOT btrfs pool of the system disk).

AFTER mounting, other directories appeared directly under /mnt2 in addition to the actual “STORAGE-POOL” mount. These are the same directories that also exist in the “STORAGE-POOL” (a mirrored copy?)

Before reinstalling Rockstor, I had the same directory structure under /mnt2/ as under /mnt2/STORAGE-POOL/. Now the mount fails under the Rockstor GUI, although I can see all mounted directories in the console and also via SCP/SFTP (everything under /mnt2/STORAGE-POOL/).
ergo: Even if the Rockstor web GUI says that the mount failed, I can see the mount successfully via SFTP.

I have not used any special btrfs mount options

Did you by chance also use say space_cache_v2 or anything like that with your prior Rockstor setup?

No, I did not use that.

phillxnet · September 9, 2021, 6:35pm

@Klapaucius Re:

yes these are the mount points. We mount all Pools and subvols to /mnt2 and so if a mount point of pool label/share name doesn’t exist then we create it and mount the subvol there.

more a discreet mount by which we can manage the subvol. Each subvol in a pool (btrfs vol) is akin, but not identical, to an entire filesystem in it’s own wright. So for management / access purposes we mount each discreetly.

You may be accessing the pool contents via it’s sub-directories. Each subvol in btrfs can be accessed via a directory change from within it’s parent pool. If you go to /mnt2/pool-name/subvol-name you are looking at the pool subvol via the parent access. If you look to /mnt2/subvol-name then it’s the Rockstor initiated descreet mount of the subvol itself. the /mnt2/pool-name mount (i.e. the /mnt2/ROOT and the /mnt2/STORAGE-POOL are the Rockstor initiated pool wide mounts (volume in btrfs speak).

So if you can see all data in /mnt2/STORAGE-POOL then Rockstor has successfully mounted to pool. But from you logs it looks like it’s failing to complete the walking of all the subvols. Can you tell, from the log, if all subvols (prior Rockstor created shares) are being found before it again updates the ROOT pool and it’s associated subvols.

You might want to try disabling quotas on the the data pool “STORAGE-POOL” as this may help to speed things up with regard to the initial import.

Could you provide the output of the following commands:

cat /proc/mounts

So we can see how far it’s got. Also if you could indicate if there are missing subvol entries in the logs.

From the logs it looks like the pool begins to import just fine and it traverses the found subvols and as it’s not seen them before it creates the mount points and adds them to the database as managed pool/subvol members. But is failing for some reason to remember each entry:

then again:

But I suspect each time it fails to complete the entire import.

I see successful find and add of:

Share name = nextcloud-data.
Share name = CALIBRE-BOOKS.
Share name = WIRESHARK-DATA.
2 subvols before:
– ROOT subvol update
Share name = nextcloud-data.
Share name = CALIBRE-BOOKS.
Share name = WIRESHARK-DATA.
Share name = BITWARDEN-DATA.
Share name = ZONEMINDER-WEBCAM-CONFIG.
5 subvols before:
– ROOT subvol update
Share name = nextcloud-data.
Share name = CALIBRE-BOOKS.
Share name = WIRESHARK-DATA.
Share name = BITWARDEN-DATA.
Share name = ZONEMINDER-WEBCAM-CONFIG.
5 subvols before:
– ROOT subvol update
Share name = nextcloud-data.
Share name = CALIBRE-BOOKS.
Share name = WIRESHARK-DATA.
Share name = BITWARDEN-DATA.
Share name = ZONEMINDER-WEBCAM-CONFIG.
5 subvols before:
– ROOT subvol update

Is this install created from our rockstor-installer or from a hand-crafted Leap 15.2 with rockstor rpm added.

An initial import can take a few minutes, what is the virtual hardware specification for this NAS instance. It looks like it’s just not completing in the given time. Something we should deal with better but we have very few reports of failed imports all in and they usually get there in the end. And as a result it looks like it’s spinning on the import without completing before other pool updates ROOT in this case, are taking priority.

Does the Pool now show but without it’s full, or any, complement of subvols. In which case try to disable quotas across both the system pool and the data pool. Another vector is to give this machine more CPU power / cores as you mention:

Is is starved of CPU speed/cores? There is a lot of this needed in btrfs at times. Also note that a minimum of 2 cores is recommended:
“Minimum system requirements”: https://rockstor.com/docs/installation/quickstart.html#minimum-system-requirements

Plus starving the VM of memory will also slow this whole process down. You have a 14 TB (28 TB raw) array after all. Not necessarily full but almost completely allocated.

Hopefully more info will help here. But from those logs there are not actual errors, just incomplete attempts at import, and variably incomplete also !! We are getting there on this one. Let us know if more cpu cores/speed helps with this import of adds to the number of subvols it get to before the ROOT update takes place. Also note that a page refresh during the import may not help things. It can be near instantaneous but it can also take a little while. Depending on the pool size / subvol, snapshot, drive count etc.

Also be sure to keep an eye on journalctl i.e. via for example:

journalctl -f

during these import attempts.

Apologies for not being of more help here but I’m still at a loss as to why the import is note completing but managing to start and proceed as expected. Lets hear what this system is running on and take it from there. The quota disable may help but if the pool is not yet know to Rockstor that may be tricky, at least from the Web-UI given there is a forced “/usr/sbin/btrfs quota enable /mnt2/STORAGE-POOL” executed each time. And disabling quotas is fast, but enabling them can be very slow. So even if you disable via command line it can slow the import up as it enables quotas in one of it’s initial steps. I think we have an issue to look at there for the future actually.

Klapaucius · September 9, 2021, 9:05pm

Many thanks! The problem is solved!

What I did was relatively simple:

I disabled the btrfs quotas after manually mounting the pool via the console.

After restarting Rockstor, I was able to successfully mount the pool via the Rockstor GUI.

So there seems to be a problem with btrfs or Rockstor to mount a pool including subvolumes, if the pool has the quotas enabled before. (bad quotas function implementation)

PS: the virtual system running the Rockstor VM has 8 vcores and 16GB RAM allocated, so there is no lack of performance.
The install ISO was created with Kiwi-NG and an OpenSuse LEap 15 installation.

phillxnet · September 10, 2021, 11:15am

@Klapaucius Glad you got this sorted and thanks for the feedback.

Re:

I think we have a confusion between mount and import here re our wording but there is definitely something going on. For a pure quotas issue I would have expected a tone of quota errors or the like. But whatever we are one step closer to a reproducer here and something is definitely in need of improvement. Lets keep an eye on this one and see if we can tease out more info on exactly the hold up here. We now at least have this report. You experimentation (read ordeal) sharing has definitely helped and thanks again for sharing your findings and work-around.

Quotas has been quite the thorny issue for quite some time unfortunately. Many improvements from our early days and in fact quotas disabled was an error state for us for the first few years. More recently we can handle it, which is handy as it’s a massive performance gain, but we and likely btrfs itself have some way before we particularly are ‘there’.

Thanks again for the exploration and reporting here.