Rock-ons not starting after new drive installation/reboot

Emmanuel_perez · December 3, 2023, 8:22pm

Hello again,
Today I installed two new drives in my machine.

I shut the machine down installed drives
Installed drives
Restarted

Now the Rock-ons/docker will not start. Any help is appreciated.

Rockstor Logs shows:

    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:20:26] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:20:26] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:20:26] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:20:33] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:20:33] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:20:33] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:35:56] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:35:56] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:35:56] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:00] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:00] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:36:00] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:03] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:03] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:36:03] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:30] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:30] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:36:30] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:33] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:33] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:36:33] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:34] ERROR [system.osi:222] non-zero code(1) returned by command: ['/usr/bin/systemctl', 'start', 'docker']. output: [''] error: ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
[03/Dec/2023 13:36:34] ERROR [storageadmin.middleware:33] Exception occurred while processing a request. Path: /api/sm/services/docker/start method: POST
[03/Dec/2023 13:36:34] ERROR [storageadmin.middleware:34] Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.', '']
Traceback (most recent call last):
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 452, in dispatch
    response = self.handle_exception(exc)
  File "/opt/rockstor/eggs/djangorestframework-3.1.1-py2.7.egg/rest_framework/views.py", line 449, in dispatch
    response = handler(request, *args, **kwargs)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/utils/decorators.py", line 145, in inner
    return func(*args, **kwargs)
  File "/opt/rockstor/src/rockstor/smart_manager/views/docker_service.py", line 102, in post
    systemctl(self.name, "start")
  File "/opt/rockstor/src/rockstor/system/services.py", line 81, in systemctl
    return run_command(arg_list, log=True)
  File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
    raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = /usr/bin/systemctl start docker. rc = 1. stdout = ['']. stderr = ['Job for docker.service failed because the control process exited with error code.', 'See "systemctl status docker.service" and "journalctl -xe" for details.',

systemctl status docker.service

Shows

Tesseract:~ # systemctl status docker.service
● docker.service - Docker Application Container Engine
     Loaded: loaded (/etc/systemd/system/docker.service; enabled; vendor preset: disabled)
     Active: failed (Result: exit-code) since Sun 2023-12-03 14:05:24 CST; 27s ago
       Docs: http://docs.docker.com
    Process: 6340 ExecStart=/usr/bin/dockerd --add-runtime oci=/usr/sbin/docker-runc $DOCKER_NETWORK_OPTIONS $DOCKER_OPTS --config-file /opt/rockstor/conf/d>
   Main PID: 6340 (code=exited, status=1/FAILURE)

Dec 03 14:05:24 Tesseract systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
Dec 03 14:05:24 Tesseract systemd[1]: Stopped Docker Application Container Engine.
Dec 03 14:05:24 Tesseract systemd[1]: docker.service: Start request repeated too quickly.
Dec 03 14:05:24 Tesseract systemd[1]: docker.service: Failed with result 'exit-code'.
Dec 03 14:05:24 Tesseract systemd[1]: Failed to start Docker Application Container Engine.

Emmanuel_perez · December 3, 2023, 8:25pm

journalctl -u docker

Tesseract:/mnt2/Rockons # journalctl -u docker
-- Logs begin at Sun 2023-12-03 13:10:49 CST, end at Sun 2023-12-03 13:52:00 CST. --
Dec 03 13:11:55 Tesseract systemd[1]: Starting Docker Application Container Engine...
Dec 03 13:11:55 Tesseract dockerd[15571]: time="2023-12-03T13:11:55-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:11:55 Tesseract dockerd[15595]: time="2023-12-03T13:11:55-06:00" level=warning msg="containerd config version `1` has been deprecated and will be removed in containerd v2.0, please switch to version `2`, see https://github.com/containerd/containerd/blob/main/docs/PLUGINS.md#version-header"
Dec 03 13:11:55 Tesseract dockerd[15595]: time="2023-12-03T13:11:55.585801455-06:00" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
Dec 03 13:11:55 Tesseract dockerd[15595]: time="2023-12-03T13:11:55.587214927-06:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
Dec 03 13:11:55 Tesseract dockerd[15595]: time="2023-12-03T13:11:55.749211410-06:00" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin"
Dec 03 13:11:57 Tesseract dockerd[15571]: time="2023-12-03T13:11:57.479668713-06:00" level=warning msg="Your kernel does not support swap memory limit"
Dec 03 13:11:57 Tesseract dockerd[15571]: time="2023-12-03T13:11:57.479733269-06:00" level=warning msg="Your kernel does not support CPU realtime scheduler"
Dec 03 13:11:57 Tesseract dockerd[15571]: time="2023-12-03T13:11:57.479753658-06:00" level=warning msg="Your kernel does not support cgroup blkio weight"
Dec 03 13:11:57 Tesseract dockerd[15571]: time="2023-12-03T13:11:57.479770391-06:00" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Dec 03 13:12:00 Tesseract dockerd[15884]: time="2023-12-03T13:12:00-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:12:00 Tesseract dockerd[15571]: time="2023-12-03T13:12:00.890717783-06:00" level=warning msg="SUSE:secrets :: removing 'old' suse secret \"suse_470acf7afbf68e1ba97cc1a2de497299d0d73662fbfb87f4ca0ab0157f25a492_credentials.d\" from container \"96d8160b2d83ae6ffcee2b56239e7bb2bcaf2c648a4ba44b2eadaa896a3ee7fa\""
Dec 03 13:12:01 Tesseract dockerd[15595]: time="2023-12-03T13:12:01.360167514-06:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Dec 03 13:12:01 Tesseract dockerd[15595]: time="2023-12-03T13:12:01.360320406-06:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Dec 03 13:12:01 Tesseract dockerd[15595]: time="2023-12-03T13:12:01.360398092-06:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Dec 03 13:12:01 Tesseract dockerd[15595]: time="2023-12-03T13:12:01.360811709-06:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/96d8160b2d83ae6ffcee2b56239e7bb2bcaf2c648a4ba44b2eadaa896a3ee7fa pid=15949 runtime=io.containerd.runc.v2
Dec 03 13:12:02 Tesseract dockerd[15571]: time="2023-12-03T13:12:02.006288935-06:00" level=warning msg="SUSE:secrets :: removing 'old' suse secret \"suse_470acf7afbf68e1ba97cc1a2de497299d0d73662fbfb87f4ca0ab0157f25a492_credentials.d\" from container \"1840928bd18766343bec89086275d893b205b200e5fea26259e6c6a2a2f689c3\""
Dec 03 13:12:02 Tesseract dockerd[15571]: time="2023-12-03T13:12:02.204681789-06:00" level=warning msg="SUSE:secrets :: removing 'old' suse secret \"suse_470acf7afbf68e1ba97cc1a2de497299d0d73662fbfb87f4ca0ab0157f25a492_credentials.d\" from container \"2b514932f440d0ec608db0649a89c2a2ca20793f4df0810bacbc50ead059e4fc\""
Dec 03 13:12:02 Tesseract dockerd[15595]: time="2023-12-03T13:12:02.939016163-06:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Dec 03 13:12:02 Tesseract dockerd[15595]: time="2023-12-03T13:12:02.939102670-06:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Dec 03 13:12:02 Tesseract dockerd[15595]: time="2023-12-03T13:12:02.939135747-06:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Dec 03 13:12:02 Tesseract dockerd[15595]: time="2023-12-03T13:12:02.939573631-06:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/1840928bd18766343bec89086275d893b205b200e5fea26259e6c6a2a2f689c3 pid=16043 runtime=io.containerd.runc.v2
Dec 03 13:12:03 Tesseract dockerd[16079]: time="2023-12-03T13:12:03-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:12:03 Tesseract dockerd[15595]: time="2023-12-03T13:12:03.580874874-06:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Dec 03 13:12:03 Tesseract dockerd[15595]: time="2023-12-03T13:12:03.580948190-06:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Dec 03 13:12:03 Tesseract dockerd[15595]: time="2023-12-03T13:12:03.580985504-06:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Dec 03 13:12:03 Tesseract dockerd[15595]: time="2023-12-03T13:12:03.581194425-06:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/2b514932f440d0ec608db0649a89c2a2ca20793f4df0810bacbc50ead059e4fc pid=16094 runtime=io.containerd.runc.v2
Dec 03 13:12:03 Tesseract dockerd[15571]: time="2023-12-03T13:12:03.719379720-06:00" level=warning msg="SUSE:secrets :: removing 'old' suse secret \"suse_470acf7afbf68e1ba97cc1a2de497299d0d73662fbfb87f4ca0ab0157f25a492_credentials.d\" from container \"b09735ae25e9dadbd801db87ed01df60323d061c405820ac94d895381b163e47\""
Dec 03 13:12:03 Tesseract dockerd[16136]: time="2023-12-03T13:12:03-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:12:03 Tesseract dockerd[16145]: time="2023-12-03T13:12:03-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:12:04 Tesseract dockerd[15595]: time="2023-12-03T13:12:04.791934327-06:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Dec 03 13:12:04 Tesseract dockerd[15595]: time="2023-12-03T13:12:04.791971944-06:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Dec 03 13:12:04 Tesseract dockerd[15595]: time="2023-12-03T13:12:04.791981651-06:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Dec 03 13:12:04 Tesseract dockerd[15595]: time="2023-12-03T13:12:04.792107631-06:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/b09735ae25e9dadbd801db87ed01df60323d061c405820ac94d895381b163e47 pid=16200 runtime=io.containerd.runc.v2
Dec 03 13:12:04 Tesseract dockerd[16240]: time="2023-12-03T13:12:04-06:00" level=info msg="SUSE:secrets :: enabled"
Dec 03 13:12:06 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: [migrations] started
Dec 03 13:12:06 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: [migrations] no migrations found
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: usermod: no changes
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: ───────────────────────────────────────
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ██╗     ███████╗██╗ ██████╗
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ██║     ██╔════╝██║██╔═══██╗
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ██║     ███████╗██║██║   ██║
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ██║     ╚════██║██║██║   ██║
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ███████╗███████║██║╚██████╔╝
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:       ╚══════╝╚══════╝╚═╝ ╚═════╝
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:    Brought to you by linuxserver.io
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: ───────────────────────────────────────
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: To support LSIO projects visit:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: https://www.linuxserver.io/donate/
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: ───────────────────────────────────────
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: GID/UID
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: ───────────────────────────────────────
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: User UID:    1000
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: User GID:    1000
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: ───────────────────────────────────────
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]:
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: **** Server already claimed ****
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: **** permissions for /dev/dri/renderD128 are good ****
Dec 03 13:12:07 Tesseract linuxserver/plex:latest/plex-linuxserver.io[15571]: **** permissions for /dev/dri/card0 are good ****
Dec 03 13:12:08 Tesseract dockerd[15571]: time="2023-12-03T13:12:08.063178674-06:00" level=warning msg="SUSE:secrets :: removing 'old' suse secret \"suse_470acf7afbf68e1ba97cc1a2de497299d0d73662fbfb87f4ca0ab0157f25a492_credentials.d\" from container \"6ad4931ca7a59c4071262172d3169618f30c50eedaa2bd4bc592d117f83adab4\""
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]: [migrations] started
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]: [migrations] no migrations found
Dec 03 13:12:09 Tesseract dockerd[15595]: time="2023-12-03T13:12:09.743756486-06:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Dec 03 13:12:09 Tesseract dockerd[15595]: time="2023-12-03T13:12:09.744002910-06:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Dec 03 13:12:09 Tesseract dockerd[15595]: time="2023-12-03T13:12:09.744110469-06:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Dec 03 13:12:09 Tesseract dockerd[15595]: time="2023-12-03T13:12:09.744576867-06:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/6ad4931ca7a59c4071262172d3169618f30c50eedaa2bd4bc592d117f83adab4 pid=16586 runtime=io.containerd.runc.v2
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]: usermod: no changes
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]: ───────────────────────────────────────
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:       ██╗     ███████╗██╗ ██████╗
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:       ██║     ██╔════╝██║██╔═══██╗
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:       ██║     ███████╗██║██║   ██║
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:       ██║     ╚════██║██║██║   ██║
Dec 03 13:12:09 Tesseract linuxserver/ombi:latest/ombi[15571]:       ███████╗███████║██║╚██████╔╝
lines 1-80

Tesseract:/ # zypper info rockstor
Loading repository data...
Warning: Repository 'Update repository of openSUSE Backports' appears to be outdated. Consider using a different mirror or server.
Reading installed packages...


Information for package rockstor:
---------------------------------
Repository     : Rockstor-Stable
Name           : rockstor
Version        : 4.1.0-0
Arch           : x86_64
Vendor         : YewTreeApps
Installed Size : 73.3 MiB
Installed      : Yes
Status         : up-to-date
Source package : rockstor-4.1.0-0.src
Upstream URL   : http://rockstor.com/
Summary        : Btrfs Network Attached Storage (NAS) Appliance.
Description    :
    Software raid, snapshot capable NAS solution with built-in file integrity protection.
    Allows for file sharing between network attached devices.

Flox · December 3, 2023, 10:29pm

Hello again, @Emmanuel_perez,

Could you please let us know the output for the following?

systemctl status -l rockstor-pre rockstor rockstor-bootstrap

My first guess that would need verification (the above would confirm/infirm that) is that something happened during the bootstrap process, resulting in your rockons-root share to not have been mounted. If that is the case, the Docker service will fail to start.

Can you access the webUI, and do you see anything unusual in your Disks/Pools pages?

Hopefully that will guide us on the right path.

Thanks a lot for thinking about detailing your Rockstor version. You should be able to update to Rockstor 4.6.1 if you are on the Stable channel, but maybe it’s more prudent to see if there’s anything wrong with the current install before proceeding with that, however.

Emmanuel_perez · December 3, 2023, 10:44pm

Hey @Flox

On first boot up after the install I did have a “Degraded Pool” message but I was able to correct that by re-seating the sata cable on the motherboard.

Currently the rock-ons started working again. I downgraded docker to version 19 thinking it may have a been a previous issue I had with docker. I then updated it to the current version and rebooted. Since then they’ve been up. I believe the false “degraded” pool was the one with my Rockons share on it. Maybe that was the issue?

Tesseract:~ # systemctl status -l rockstor-pre rockstor rockstor-bootstrap
● rockstor-pre.service - Tasks required prior to starting Rockstor
     Loaded: loaded (/etc/systemd/system/rockstor-pre.service; enabled; vendor preset: disabled)
     Active: active (exited) since Sun 2023-12-03 15:30:54 CST; 1h 2min ago
   Main PID: 889 (code=exited, status=0/SUCCESS)

Dec 03 15:30:54 Tesseract initrock[889]:   File "/opt/rockstor/src/rockstor/scripts/initrock.py", line 52, >
Dec 03 15:30:54 Tesseract initrock[889]:     o, _, _ = run_command(cmd)
Dec 03 15:30:54 Tesseract initrock[889]:   File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in ru>
Dec 03 15:30:54 Tesseract initrock[889]:     raise CommandException(cmd, out, err, rc)
Dec 03 15:30:54 Tesseract initrock[889]: CommandException: Error running a command. cmd = /usr/sbin/ip addr>
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,374: Normalising on shellinaboxd service file
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,375: - shellinaboxd.service already exists
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,376: rockstor service looks correct. Not updat>
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,377: rockstor-bootstrap.service looks correct.>
Dec 03 15:30:54 Tesseract systemd[1]: Finished Tasks required prior to starting Rockstor.

● rockstor.service - RockStor startup script
     Loaded: loaded (/etc/systemd/system/rockstor.service; enabled; vendor preset: disabled)
     Active: active (running) since Sun 2023-12-03 15:30:54 CST; 1h 2min ago
   Main PID: 13362 (supervisord)
      Tasks: 15
     CGroup: /system.slice/rockstor.service
             ├─ 4538 btrfs balance start -mconvert raid10 -dconvert raid10 -f /mnt2/14tb_R1
             ├─13362 /usr/bin/python2 /opt/rockstor/bin/supervisord -c /opt/rockstor/etc/supervisord.conf
             ├─13471 nginx: master process /usr/sbin/nginx -c /opt/rockstor/etc/nginx/nginx.conf
             ├─13472 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.>
             ├─13473 /usr/bin/python2 /opt/rockstor/bin/data-collector
             ├─13474 /usr/bin/python2.7 /opt/rockstor/bin/django run_huey --workers 2 --worker-type thread >
             ├─13475 nginx: worker process
             ├─13476 nginx: worker process
             ├─13490 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.>
             └─13492 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.>

Dec 03 15:30:54 Tesseract supervisord[13362]: 2023-12-03 15:30:54,564 CRIT Server 'unix_http_server' runnin>
lines 1-34...skipping...
● rockstor-pre.service - Tasks required prior to starting Rockstor
     Loaded: loaded (/etc/systemd/system/rockstor-pre.service; enabled; vendor preset: disabled)
     Active: active (exited) since Sun 2023-12-03 15:30:54 CST; 1h 2min ago
   Main PID: 889 (code=exited, status=0/SUCCESS)

Dec 03 15:30:54 Tesseract initrock[889]:   File "/opt/rockstor/src/rockstor/scripts/initrock.py", line 52, in inet_addrs
Dec 03 15:30:54 Tesseract initrock[889]:     o, _, _ = run_command(cmd)
Dec 03 15:30:54 Tesseract initrock[889]:   File "/opt/rockstor/src/rockstor/system/osi.py", line 224, in run_command
Dec 03 15:30:54 Tesseract initrock[889]:     raise CommandException(cmd, out, err, rc)
Dec 03 15:30:54 Tesseract initrock[889]: CommandException: Error running a command. cmd = /usr/sbin/ip addr show . rc = 1. stdout = ['']. stderr = ['Device "" does not exist.', '']
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,374: Normalising on shellinaboxd service file
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,375: - shellinaboxd.service already exists
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,376: rockstor service looks correct. Not updating.
Dec 03 15:30:54 Tesseract initrock[889]: 2023-12-03 15:30:54,377: rockstor-bootstrap.service looks correct. Not updating.
Dec 03 15:30:54 Tesseract systemd[1]: Finished Tasks required prior to starting Rockstor.

● rockstor.service - RockStor startup script
     Loaded: loaded (/etc/systemd/system/rockstor.service; enabled; vendor preset: disabled)
     Active: active (running) since Sun 2023-12-03 15:30:54 CST; 1h 2min ago
   Main PID: 13362 (supervisord)
      Tasks: 15
     CGroup: /system.slice/rockstor.service
             ├─ 4538 btrfs balance start -mconvert raid10 -dconvert raid10 -f /mnt2/14tb_R1
             ├─13362 /usr/bin/python2 /opt/rockstor/bin/supervisord -c /opt/rockstor/etc/supervisord.conf
             ├─13471 nginx: master process /usr/sbin/nginx -c /opt/rockstor/etc/nginx/nginx.conf
             ├─13472 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.pid --workers=2 --log-file=/opt/rockstor/var/log/gunicorn.log --pythonpath=/opt/rockstor/src/rockstor ->
             ├─13473 /usr/bin/python2 /opt/rockstor/bin/data-collector
             ├─13474 /usr/bin/python2.7 /opt/rockstor/bin/django run_huey --workers 2 --worker-type thread --logfile /opt/rockstor/var/log/huey.log
             ├─13475 nginx: worker process
             ├─13476 nginx: worker process
             ├─13490 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.pid --workers=2 --log-file=/opt/rockstor/var/log/gunicorn.log --pythonpath=/opt/rockstor/src/rockstor ->
             └─13492 /usr/bin/python2 /opt/rockstor/bin/gunicorn --bind=127.0.0.1:8000 --pid=/run/gunicorn.pid --workers=2 --log-file=/opt/rockstor/var/log/gunicorn.log --pythonpath=/opt/rockstor/src/rockstor ->

Dec 03 15:30:54 Tesseract supervisord[13362]: 2023-12-03 15:30:54,564 CRIT Server 'unix_http_server' running without any HTTP authentication checking
Dec 03 15:30:54 Tesseract supervisord[13362]: 2023-12-03 15:30:54,564 INFO supervisord started with pid 13362
Dec 03 15:30:55 Tesseract supervisord[13362]: 2023-12-03 15:30:55,568 INFO spawned: 'nginx' with pid 13471
Dec 03 15:30:55 Tesseract supervisord[13362]: 2023-12-03 15:30:55,571 INFO spawned: 'gunicorn' with pid 13472
Dec 03 15:30:55 Tesseract supervisord[13362]: 2023-12-03 15:30:55,572 INFO spawned: 'data-collector' with pid 13473
Dec 03 15:30:55 Tesseract supervisord[13362]: 2023-12-03 15:30:55,573 INFO spawned: 'ztask-daemon' with pid 13474
Dec 03 15:30:57 Tesseract supervisord[13362]: 2023-12-03 15:30:57,927 INFO success: data-collector entered RUNNING state, process has stayed up for > than 2 seconds (startsecs)
Dec 03 15:31:00 Tesseract supervisord[13362]: 2023-12-03 15:31:00,931 INFO success: nginx entered RUNNING state, process has stayed up for > than 5 seconds (startsecs)
Dec 03 15:31:00 Tesseract supervisord[13362]: 2023-12-03 15:31:00,932 INFO success: gunicorn entered RUNNING state, process has stayed up for > than 5 seconds (startsecs)
Dec 03 15:31:05 Tesseract supervisord[13362]: 2023-12-03 15:31:05,942 INFO success: ztask-daemon entered RUNNING state, process has stayed up for > than 10 seconds (startsecs)

● rockstor-bootstrap.service - Rockstor bootstrapping tasks
     Loaded: loaded (/etc/systemd/system/rockstor-bootstrap.service; enabled; vendor preset: enabled)
     Active: active (exited) since Sun 2023-12-03 15:31:38 CST; 1h 1min ago
    Process: 13363 ExecStart=/opt/rockstor/bin/bootstrap (code=exited, status=0/SUCCESS)
   Main PID: 13363 (code=exited, status=0/SUCCESS)

Dec 03 15:30:54 Tesseract systemd[1]: Starting Rockstor bootstrapping tasks...
Dec 03 15:31:38 Tesseract bootstrap[13363]: BTRFS device scan complete
Dec 03 15:31:38 Tesseract bootstrap[13363]: Bootstrapping complete
Dec 03 15:31:38 Tesseract bootstrap[13363]: Running qgroup cleanup. /opt/rockstor/bin/qgroup-clean
Dec 03 15:31:38 Tesseract bootstrap[13363]: Running qgroup limit maxout. /opt/rockstor/bin/qgroup-maxout-limit
Dec 03 15:31:38 Tesseract systemd[1]: Finished Rockstor bootstrapping tasks.

Also not super confident the issue will not come back on next reboot…

Emmanuel_perez · December 3, 2023, 10:45pm

Just checked, the degraded pool was not the one with the Rockons share on it.

phillxnet · December 4, 2023, 4:15pm

@Emmanuel_perez Hello again.
Just wanted to chip-in on:

If a pool has been degraded, even for a bit, it’s always best to do a scrub to ensure it’s integrity. We have seen it where if one pool fails a mount, another does also. Could be the knock-on that lead to the Rock-ons-root host pool also not mounting. But that is entirely a guess I’m afraid.

Glad your back up and running again: and we are now approaching the next Release Candidate phase in testing (but not quite just yet) so soon there-after we have very many updates to release into the stable channel. Bit by bit.

Hope that helps.

Emmanuel_perez · December 7, 2023, 2:48am

Thanks for the tip @phillxnet
I went ahead and did the scrub also found some errors on a drive on my pool that holds the Rock-ons share. Replaced the the drive, rebuilt the pool, and ran another scrub but im still having issues with the Rock-ons starting up.

I was able to get them up after a reboot but tried rebooting again and they have not come up yet.

Tesseract:~ # systemctl status docker.service
● docker.service - Docker Application Container Engine
     Loaded: loaded (/etc/systemd/system/docker.service; enabled; vendor preset: disabled)
     Active: failed (Result: exit-code) since Wed 2023-12-06 20:48:29 CST; 45s ago
       Docs: http://docs.docker.com
    Process: 1242 ExecStart=/usr/bin/dockerd --add-runtime oci=/usr/sbin/docker-runc $DOCKER_NETWORK_OPTION>
   Main PID: 1242 (code=exited, status=1/FAILURE)

Dec 06 20:48:29 Tesseract systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
Dec 06 20:48:29 Tesseract systemd[1]: Stopped Docker Application Container Engine.
Dec 06 20:48:29 Tesseract systemd[1]: docker.service: Start request repeated too quickly.
Dec 06 20:48:29 Tesseract systemd[1]: docker.service: Failed with result 'exit-code'.
Dec 06 20:48:29 Tesseract systemd[1]: Failed to start Docker Application Container Engine.

Emmanuel_perez · December 7, 2023, 3:05am

I gave chatgpt a try it seems that /var/run/docker.sock was a directory. Deleted it and restarted docker and its working so far…

Chatgpt output:

Step 1: Remove the existing `/var/run/docker.sock` directory

bash

sudo rm -r /var/run/docker.sock

Step 2: Restart the Docker service

bash

sudo systemctl restart docker.service

Step 3: Check the status of the Docker service

bash

sudo systemctl status docker.service

Step 4: Review Docker daemon logs

bash

journalctl -u docker.service

Step 5: If the issue persists, reinstall Docker

bash

sudo zypper remove docker
sudo zypper install docker
sudo systemctl restart docker.service

Hooverdan · December 7, 2023, 3:56pm

Seems that this has been an issue in other scenarios as well (a thread started back in 2017 or so):

github.com/moby/moby

can't create unix socket /var/run/docker.sock: is a directory

opened 08:59AM - 22 Jan 17 UTC

stuszynski

area/api area/runtime version/1.12

**Description**  **Steps to reproduce the issue:** 1. Restart Docker **Describe the results you received:** Docker can't boot up after a restart. An error from journal: ``` dockerd[30701]: time="2017-01-22T08:38:55.077780858Z" level=fatal msg="can't create unix socket /var/run/docker.sock: is a directory" ``` At this point `/var/run/docker.sock` is indeed, a directory. (wut?) ``` $ ls -lah /var/run/docker.sock total 0 drwxr-xr-x 2 root root 40 Jan 22 08:37 . drwxr-xr-x 30 root root 1.2K Jan 22 08:38 .. ``` **Describe the results you expected:** To restart Docker without an error **Additional information you deem important (e.g. issue happens only occasionally):** This happened from time to time upon restart of `dockerd` daemon. After I removed this directory manually, Docker boots up easily creating a socket, but after several restarts, this issue came back. **Output of `docker version`:** ``` Client: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Wed Jan 11 00:23:16 2017 OS/Arch: linux/amd64 Server: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Wed Jan 11 00:23:16 2017 OS/Arch: linux/amd64 ``` **Output of `docker info`:** ``` Containers: 42 Running: 20 Paused: 0 Stopped: 22 Images: 14 Server Version: 1.12.6 Storage Driver: overlay Backing Filesystem: xfs Logging Driver: json-file Cgroup Driver: cgroupfs Plugins: Volume: local Network: overlay bridge null host Swarm: inactive Runtimes: runc Default Runtime: runc Security Options: apparmor seccomp Kernel Version: 4.4.0-57-generic Operating System: Ubuntu 16.04.1 LTS OSType: linux Architecture: x86_64 CPUs: 2 Total Memory: 7.795 GiB Name: <node-name> ID: <id> Docker Root Dir: /var/lib/docker Debug Mode (client): false Debug Mode (server): false Registry: https://index.docker.io/v1/ WARNING: No swap limit support Insecure Registries: 127.0.0.0/8 ``` **Additional environment details (AWS, VirtualBox, physical, etc.):** AWS EC2 instance

and we had at least on reports on this problem on the Rockstor forum, too.

Rock-ons not starting after new drive installation/reboot

Step 1: Remove the existing /var/run/docker.sock directory

Step 2: Restart the Docker service

Step 3: Check the status of the Docker service

Step 4: Review Docker daemon logs

Step 5: If the issue persists, reinstall Docker

Step 1: Remove the existing `/var/run/docker.sock` directory