Lost data from share and WEBUI inaccessable after update

After installing a daily update, i got some error messages in the webUI. It stated that after i reboot , i would be taken back to a stable version. So i rebooted and after that reboot my WEBUI does not work anymore. I can SSH into the machine.
Also the share is empty, my data seems to have dissapeared?

very frustrating , as it seems that also my replicated data on to a second server is not accessable because the share name seems to be to long…

please HELP!

Since you can SSH into the machine, can you review the log to see whether additional errors have occurred during the reboot (found in the /opt/rockstor/var/log/ directory)?

What version of Rockstor are you currently running (yum info rockstor)?
Are you using a Samba share or something else like NFS, etc.?
Does the mount command show you all mounted shares correctly (lsblk should also show you the mountpoints)?

I had an issue in the past, where the contents of a share seemed to have disappeared. I fixed it by removing and creating the share again, but for that I also had access to the WebUI which you don’t seem to have at this time.

You could also try to restart Rockstor from within SSH and see whether that gives back access to your WebUI (systemctl restart rockstor).

Could you also post the output of the following command?
systemctl status -l rockstor-pre rockstor rockstor-bootstrap

It may help narrow down which one fails…

current version rockstor is

Name : rockstor
Arch : x86_64
Version : 3.9.1
Release : 16
Size : 85 M
Repo : installed
From repo : Rockstor-Testing
Summary : RockStor – Store Smartly
License : GPL
Description : RockStor – Store Smartly

result from trying to restart rockstor with systemctl restart rockstor

Blockquote-- Unit rockstor-pre.service has begun starting up.
Jan 02 21:45:13 server1 initrock[18473]: 2018-01-02 21:45:13,975: Supported kernel(/boot/vmlinuz-4.12.4-1.el7.elrepo.x86_64) is already the default
Jan 02 21:45:14 server1 initrock[18473]: 2018-01-02 21:45:14,186: /etc/rc.d/rc.local looks correct. Not updating.
Jan 02 21:45:14 server1 initrock[18473]: 2018-01-02 21:45:14,186: Checking for flash and Running flash optimizations if appropriate.
Jan 02 21:45:15 server1 initrock[18473]: 2018-01-02 21:45:15,541: Updating the timezone from the system
Jan 02 21:45:15 server1 initrock[18473]: 2018-01-02 21:45:15,542: system timezone = Europe/Amsterdam
Jan 02 21:45:15 server1 initrock[18473]: 2018-01-02 21:45:15,545: Updating sshd_config
Jan 02 21:45:15 server1 initrock[18473]: 2018-01-02 21:45:15,551: sshd_config already has the updates. Leaving it unchanged.
Jan 02 21:45:15 server1 initrock[18473]: 2018-01-02 21:45:15,551: Running app database migrations…
Jan 02 21:45:21 server1 initrock[18473]: Traceback (most recent call last):
Jan 02 21:45:21 server1 initrock[18473]: File “/opt/rockstor/bin/initrock”, line 45, in
Jan 02 21:45:21 server1 initrock[18473]: sys.exit(scripts.initrock.main())
Jan 02 21:45:21 server1 initrock[18473]: File “/opt/rockstor/src/rockstor/scripts/initrock.py”, line 423, in main
Jan 02 21:45:21 server1 initrock[18473]: run_command(migration_cmd + [‘storageadmin’])
Jan 02 21:45:21 server1 initrock[18473]: File “/opt/rockstor/src/rockstor/system/osi.py”, line 121, in run_command
Jan 02 21:45:21 server1 initrock[18473]: raise CommandException(cmd, out, err, rc)
Jan 02 21:45:21 server1 initrock[18473]: system.exceptions.CommandException: Error running a command. cmd = /opt/rockstor/bin/django migrate --noinput storageadmin. rc = 1. stdout = [‘Operations to
Jan 02 21:45:21 server1 initrock[18473]: ", line 80, in get_for_model’, ’ "Error creating new content types. Please make sure contenttypes "’, 'RuntimeError: Error creating new content types. Pl
Jan 02 21:45:21 server1 systemd[1]: rockstor-pre.service: main process exited, code=exited, status=1/FAILURE
Jan 02 21:45:21 server1 systemd[1]: Failed to start Tasks required prior to starting Rockstor.
– Subject: Unit rockstor-pre.service has failed
– Defined-By: systemd
– Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

– Unit rockstor-pre.service has failed.

– The result is failed.
Jan 02 21:45:21 server1 systemd[1]: Dependency failed for RockStor startup script.
– Subject: Unit rockstor.service has failed
– Defined-By: systemd
– Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

– Unit rockstor.service has failed.

– The result is dependency.
Jan 02 21:45:21 server1 systemd[1]: Job rockstor.service/start failed with result ‘dependency’.
Jan 02 21:45:21 server1 systemd[1]: Unit rockstor-pre.service entered failed state.
Jan 02 21:45:21 server1 systemd[1]: rockstor-pre.service failed.

Blockquote

output from systemctl status -l rockstor-pre rockstor rockstor-bootstrap

Blockquote
rockstor-pre.service - Tasks required prior to starting Rockstor
Loaded: loaded (/etc/systemd/system/rockstor-pre.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Tue 2018-01-02 21:45:21 CET; 5min ago
Process: 18473 ExecStart=/opt/rockstor/bin/initrock (code=exited, status=1/FAILURE)
Main PID: 18473 (code=exited, status=1/FAILURE)

Jan 02 21:45:21 server1 initrock[18473]: File “/opt/rockstor/src/rockstor/scripts/initrock.py”, line 423, in main
Jan 02 21:45:21 server1 initrock[18473]: run_command(migration_cmd + [‘storageadmin’])
Jan 02 21:45:21 server1 initrock[18473]: File “/opt/rockstor/src/rockstor/system/osi.py”, line 121, in run_command
Jan 02 21:45:21 server1 initrock[18473]: raise CommandException(cmd, out, err, rc)
Jan 02 21:45:21 server1 initrock[18473]: system.exceptions.CommandException: Error running a command. cmd = /opt/rockstor/bin/django migrate --noinput storageadmin. rc = 1. stdout = [‘Operations to perform:’, ’ Apply all migrations: storageadmin’, ‘Running migrations:’, ’ No migrations to apply.’, ‘’]. stderr = [‘Traceback (most recent call last):’, ’ File “/opt/rockstor/bin/django”, line 44, in ‘, " sys.exit(djangorecipe.manage.main(‘rockstor.settings’))", ’ File “/opt/rockstor/eggs/djangorecipe-1.9-py2.7.egg/djangorecipe/manage.py”, line 9, in main’, ’ management.execute_from_command_line(sys.argv)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/init.py”, line 354, in execute_from_command_line’, ’ utility.execute()’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/init.py”, line 346, in execute’, ’ self.fetch_command(subcommand).run_from_argv(self.argv)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/base.py”, line 394, in run_from_argv’, ’ self.execute(*args, **cmd_options)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/base.py”, line 445, in execute’, ’ output = self.handle(*args, **options)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/commands/migrate.py”, line 226, in handle’, ’ emit_post_migrate_signal(created_models, self.verbosity, self.interactive, connection.alias)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/management/sql.py”, line 280, in emit_post_migrate_signal’, ’ using=db)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/dispatch/dispatcher.py”, line 189, in send’, ’ response = receiver(signal=self, sender=sender, **named)’, ’ File “/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/contrib/auth/management/init.py”, line 82, in create_permissions’, ’ ctype = ContentType.objects.db_manager(using).get_for_model(klass)’, ’ File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/contrib/contenttypes/models.py
Jan 02 21:45:21 server1 initrock[18473]: ", line 80, in get_for_model’, ’ "Error creating new content types. Please make sure contenttypes "’, ‘RuntimeError: Error creating new content types. Please make sure contenttypes is migrated before trying to migrate apps individually.’, ‘’]
Jan 02 21:45:21 server1 systemd[1]: rockstor-pre.service: main process exited, code=exited, status=1/FAILURE
Jan 02 21:45:21 server1 systemd[1]: Failed to start Tasks required prior to starting Rockstor.
Jan 02 21:45:21 server1 systemd[1]: Unit rockstor-pre.service entered failed state.
Jan 02 21:45:21 server1 systemd[1]: rockstor-pre.service failed.

● rockstor.service - RockStor startup script
Loaded: loaded (/etc/systemd/system/rockstor.service; enabled; vendor preset: enabled)
Active: inactive (dead)

Jan 01 17:37:02 server1 systemd[1]: Dependency failed for RockStor startup script.
Jan 01 17:37:02 server1 systemd[1]: Job rockstor.service/start failed with result ‘dependency’.
Jan 02 21:45:21 server1 systemd[1]: Dependency failed for RockStor startup script.
Jan 02 21:45:21 server1 systemd[1]: Job rockstor.service/start failed with result ‘dependency’.

● rockstor-bootstrap.service - Rockstor bootstrapping tasks
Loaded: loaded (/etc/systemd/system/rockstor-bootstrap.service; enabled; vendor preset: disabled)
Active: inactive (dead)

Jan 01 17:37:02 server1 systemd[1]: Dependency failed for Rockstor bootstrapping tasks.
Jan 01 17:37:02 server1 systemd[1]: Job rockstor-bootstrap.service/start failed with result ‘dependency’.

Blockquote

lsblk shows :slight_smile:
[root@server1 log]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdd 8:48 0 931.5G 0 disk
sdb 8:16 0 931.5G 0 disk
sdc 8:32 0 931.5G 0 disk
sda 8:0 0 232.9G 0 disk
├─sda2 8:2 0 7.3G 0 part [SWAP]
├─sda3 8:3 0 225.2G 0 part /home
└─sda1 8:1 0 500M 0 part /boot

Not sure what the issue is, but I am not that experienced either … did you do the reboot after an upgrade? In this thread, a similar error message was experienced, and a github issue was opened, referencing a workaround thread if it went wrong:

1 Like

that helped! at least partially. I downgraded to an older version. I could then access the WEBUI again.
But it showed all shares unmounted.
I manually mounted the shares via SSH, and turned on quota wich game me access back to my share.
Then i had to manually change the config of smb.cfg to add the share to samba as i could not do this via the WEBUI.
trying to export the share via sambo in theWEBUI resulted in an error. When i manually edited cfg.smb and added the share i had access again…

time to get my data somewhere safe!

@sander
glad to hear that you finally got the shares back. Did you attempt the upgrade after that downgrade as well? Apparently, the transition from docker to docker-ce caused some issues, where the upstream development messed with quotas and hence resulting in unmounted volumes - I ran into this issue as well. Check out this thread:

Do you happen to have a screenshot of the error the Webui was throwing when you tried to add a share through the UI? Also, now that you have manually edited cfg.smb, are those shares now showing in the WebUI (I don’t know that they should, but I am curious).

I’ve been running Rockstor now for more than a year, and so far (knock on wood) no data loss …