rockstor-pre.service crashed after updating to rockstor-5.0.5-0.x86_64.

philuser · October 22, 2023, 4:41pm

following the zypper up --no-recommends update to rockstor 5.0.5, the process rockstor-pre.service: Failed with result ‘exit-code’. Result: no more WEB-UI

my last upgrade

Output from journalctl -xeu rockstor-pre.service command

As well as the currently active postgresql version:

I’m doc not exactly in the configuration of previous messages dealing with a similar problem, in any case the proposed solutions are not operative here.

Flox · October 22, 2023, 4:48pm

Hi @philuser ,

Welcome to the forum, but sorry it’s for reporting an issue with your update.

I believe you are on the right track here, although we did put some safeguards to protect against what was found in a related thread to which I believe you refer (this one: Upgrade to 5.0.1-0 from 4.6.1 rockstor fails), you may experience something else. I do see a couple errors in the screenshot from zypper update --no-recommends but I’m not sure these would have been responsible for the failure to install.

Let’s thus see if we can see what happened in your case exactly.

From which Rockstor version did you update? 5.0.3 or earlier?
Could you paste the output from the install log? You can find it at:

cat /opt/rockstor/poetry-install.txt

This should help put us on the right track.

philuser · October 23, 2023, 9:26am

Ok, thank you for your quick reply.

Concerning the version, here is the procedure followed:
- Install from iso: Rockstor-Leap15.4-generic.x86_64-4.5.8-0.install.iso
- Follow the instructions in cli
  - zypper refersh
  - zypper up --no-recomends
then in the WEB-UI interface, I validated the developer mode (from memory there were 2 proposals, Standard and Developer, or something similar). This, seen on the CLI console, generated a new update (with no errors, it seems), with a final request for a reboot, to validate the updates. It was during the reboot that I lost the WEB-UI.

Then I started a new zypper up --no-recomends out of a clear conscience, in case something had gone wrong. The situation of the previous message
Concerning the return of the `cat
- 884×224 53.6 KB

< sorry for the succession of messages, but for now if I include more element I have a return :
An error occurred: Sorry, new users can only put one embedded media item in a post. >

philuser · October 23, 2023, 9:27am

So I updated my Python versions with update-alternatives.
- 818×164 51.7 KB

philuser · October 23, 2023, 9:28am

||-

philuser · October 23, 2023, 9:28am

|

philuser · October 23, 2023, 9:29am

And to regenerate the virtual environment for poetry

philuser · October 23, 2023, 9:30am

Then restart the service
- 1038×62 26.3 KB

philuser · October 23, 2023, 9:30am

Without success! So back to the log
- 1158×868 369 KB

philuser · October 23, 2023, 9:31am

and interogate the cat
- 883×227 53.2 KB
Here I am! Any help would be appreciated, Thank you

Flox · October 23, 2023, 11:39am

Thanks for the detailed rundown!
I’ve increased your trust level here so that you don’t have the new user restrictions anymore.

Note that the message you see about the “Python versions not being supported by the project” is actually normal, or at least the expected behavior. This is soon to be behind us as we quickly move towards a more modern version of Poetry (Update Poetry build system · Issue #2703 · rockstor/rockstor-core · GitHub). In that message you can see that Poetry is still able to find a Python version (3.9) compatible with the project (Rockstor) and is using it to create the venv. All of Rockstor python bits run under that venv so you shouldn’t have to mess with your system Python version. From the cat /opt/Rockstor/poetry-install.txt output we can see, it confirms that it can actually create the venv as expected and install the dependencies.

We would need to see the full output of it, however. Would you be able to copy-paste it here? Connecting to your Rockstor machine via SSH usually is the most convenient way to get this kind of output as you can easily copy contents from the terminal that way.

This is the file that should tell us what happened during the rockstor install.

phillxnet · October 23, 2023, 12:16pm

@philuser Hello there, just chipping on this one:
Re:

That would be a OS breaking move: We depend on Python 3.9 hence the new installs you saw initially - but hey can co-exist with the 3.6 (EOL) that the OS uses. Do not change the alternatives as that will break the OS - it assumes 3.6 but we use 3.9 with our .venv.

You would be advised to start afresh I think. Or at least return the alternatives for the OS python.

Our build system Poetry - indicated it’s successful find and use of Py3.9 - it is very bad to change an OS alternatives for the Python !!! And we do not require this or we would do it, as we do with the postgresql, via our rpm scripts. The Poetry .venv does this but just for us. We run all our stuff via poetry and so can use it’s redirection to use a non EOL Python.

And my apologies for not being able to help further on this one. I did personally test an install from download to 5.0.4-0 more recently and all was OK. However I used the Web-UI only for that.

Try:

Fresh install
Web-UI setup and select testing.
Use Web-UI to update, as per the recommendation in the cli.

Our cli should work but we have had very many changes to date. Lets get back to a system that has not had it’s entire default Python changed :). As @Flox mentions, the Poetry is doing it’s thing and stating it’s successful find and use of the parallel (non OS default) Py3.9.

Unfortunately your Python alternatives change here has taken the entire OS way off limits - hence the suggestion to re-do from scratch from the installer and try doing all updates via the Web-UI.

Hope that helps.

philuser · October 23, 2023, 4:27pm

Ok, thanks already for your feedback it’s really very professional.
as proposed, I opted for a complete reinstallation
After having re-downloaded the ISO Rockstor-Leap15.4-generic.x86_64-4.5.8-0.install.iso no way to launch the installation! squashfs error in the middle of the installation file (after selecting the installation disk). Change USB key, download again … same thing. After a third unsuccessful attempt, I decide to test the “Tumbleweed” version Rockstor-Tumbleweed-generic.x86_64-4.5.8-0.install.iso bingo, it works!.

I’ll start by taking stock of the situation.

```
PhilRock:/opt/rockstor # ls -la
total 692
drwxr-xr-x 1 root root    516 oct.  23 17:09 .
dr-xr-xr-x 1 root root     16 mars  16  2023 ..
-rwxr--r-- 1 root root   2987 mars  15  2023 build.sh
drwxr-xr-x 1 root root     92 oct.  23 17:08 certs
drwxr-xr-x 1 root root    506 mars  16  2023 conf
-rw-r--r-- 1 root root  35147 mars  15  2023 COPYING
drwxr-xr-x 1 root root     54 mars  16  2023 etc
-rw-r--r-- 1 root root      0 oct.  23 17:09 .initrock
drwxr-xr-x 1 root root      4 mars  16  2023 jslibs
-rw-r--r-- 1 root root   6608 mars  15  2023 PKG-INFO
-rw-r--r-- 1 root root   1383 mars  16  2023 poetry-install.txt
-rw-r--r-- 1 root root  34129 mars  15  2023 poetry.lock
-rw-r--r-- 1 root root     32 mars  15  2023 poetry.toml
-rw-r--r-- 1 root root   5367 mars  15  2023 pyproject.toml
-rw-r--r-- 1 root root   4670 mars  15  2023 README.md
-rw-r--r-- 1 root root 532002 mars  15  2023 rockstor-jslibs.tar.gz
-rw-r--r-- 1 root root     89 mars  15  2023 rockstor-jslibs.tar.gz.sha256sum
-rw-r--r-- 1 root root  28672 mars  16  2023 rockstor-tasks-huey.db
-rw-r--r-- 1 root root  32768 oct.  23 17:09 rockstor-tasks-huey.db-shm
-rw-r--r-- 1 root root      0 oct.  23 17:09 rockstor-tasks-huey.db-wal
drwxr-xr-x 1 root root     16 mars  16  2023 src
drwxr-xr-x 1 root root     66 mars  16  2023 static
drwxr-xr-x 1 root root      6 mars  16  2023 var
drwxr-xr-x 1 root root     76 mars  16  2023 .venv
```

Web-UI OK

Then validate Testing Updates mode
after the update countdown, Web-UI mode hangs up with the message 502 Bad Gateway.
I re-run the poetry file

PhilRock:/opt/rockstor # cat poetry-install.txt
The currently activated Python version 3.10.10 is not supported by the project (~3.9).
Trying to find and use a compatible version.
Using python3.9 (3.9.18)
Creating virtualenv rockstor in /opt/rockstor/.venv
Installing dependencies from lock file

Package operations: 34 installs, 0 updates, 0 removals

• Installing h11 (0.14.0)

This seems incomplete, with a python upgrade to version 10 !

More than an hour later, the zypper update process is still locked, see :

PhilRock:/opt/rockstor # zypper ref

System management is locked by the application with pid 3884 (/usr/bin/zypper).
Close this application before trying again.

Something is not terminating correctly !!!

philuser · October 23, 2023, 5:23pm

after reboot still no Web-UI, but with a more extensive poetry-install.txt.

The currently activated Python version 3.10.10 is not supported by the project (~3.9).
Trying to find and use a compatible version.
Using python3.9 (3.9.18)
Creating virtualenv rockstor in /opt/rockstor/.venv
Installing dependencies from lock file

Package operations: 34 installs, 0 updates, 0 removals

• Installing h11 (0.14.0)
• Installing wsproto (1.2.0)
• Installing certifi (2023.7.22)
• Installing charset-normalizer (3.3.0)
• Installing idna (3.4)
• Installing pytz (2023.3.post1)
• Installing simple-websocket (1.0.0)
• Installing sqlparse (0.4.4)
• Installing urllib3 (2.0.7)
• Installing bidict (0.22.1)
• Installing django (2.2.28)
• Installing oauthlib (3.1.0)
• Installing packaging (23.2)
• Installing greenlet (3.0.0)
• Installing zope.event (5.0)
• Installing requests (2.31.0)
• Installing python-engineio (4.8.0)
• Installing zope.interface (6.1)
• Installing dbus-python (1.2.18)
• Installing distro (1.8.0)
• Installing django-pipeline (2.1.0)
• Installing django-oauth-toolkit (1.1.2)
• Installing djangorestframework (3.13.1)
• Installing gunicorn (21.2.0)
• Installing gevent (23.9.1)
• Installing huey (2.3.0)

and for the rockstor-pre service

# journalctl -xeu rockstor-pre.service
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ L'unité (unit) rockstor-pre.service a commencé à démarrer.
oct. 23 19:06:20 PhilRock poetry[1240]: Traceback (most recent call last):
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<string>", line 1, in <module>
oct. 23 19:06:20 PhilRock poetry[1240]:   File "/usr/lib64/python3.9/importlib/__init__.py", line 127, in import_module
oct. 23 19:06:20 PhilRock poetry[1240]:     return _bootstrap._gcd_import(name[level:], package, level)
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 972, in _find_and_load_unlocked
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 984, in _find_and_load_unlocked
oct. 23 19:06:20 PhilRock poetry[1240]: ModuleNotFoundError: No module named 'scripts'
oct. 23 19:06:20 PhilRock systemd[1]: rockstor-pre.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ An ExecStart= process belonging to unit rockstor-pre.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
oct. 23 19:06:20 PhilRock systemd[1]: rockstor-pre.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit rockstor-pre.service has entered the 'failed' state with result 'exit-code'.
oct. 23 19:06:20 PhilRock systemd[1]: Failed to start Tasks required prior to starting Rockstor.
░░ Subject: L'unité (unit) rockstor-pre.service a échoué
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ L'unité (unit) rockstor-pre.service a échoué, avec le résultat failed.
oct. 23 19:06:20 PhilRock systemd[1]: rockstor-pre.service: Consumed 1.255s CPU time.
░░ Subject: Ressources consommées durant l'éxécution de l'unité (unit)
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ L'unité (unit) rockstor-pre.service s'est arrêtée et a consommé les ressources indiquées.

Flox · October 23, 2023, 6:03pm

Thanks for the additional details. All of that is very odd. It seems something hands or is interrupted in the middle of the dependency installation phase from what we can see but that’s something I’ve personally never seen before.

I am curious if running that step manually would provide us with more clues. If you change, would you do the following?

cd /opt/rockstor
poetry install

I’m particularly curious about timing here and reproducibility. In other words, does it stop, does it fail, immediately, or does it hang for quite some time until it times out?
Also, does it always do the same thing if you repeat it? (assuming it doesn’t complete successfully, of course)

philuser · October 23, 2023, 6:32pm

Ouch!

PhilRock:/opt/rockstor # poetry install
bash: poetry: command not found

indeed, some stuff must be missing here!
I’m ready to follow the procedure you want, relaunching a new installation. but the previous one didn’t inform me of any particular incident.

already the log on poetry

PhilRock:/opt/rockstor # journalctl |grep poetry
oct. 23 17:08:16 PhilRock.home poetry[1595]: 2023-10-23 16:08:16,227: Creating openssl cert...
oct. 23 17:08:16 PhilRock.home poetry[1595]: 2023-10-23 16:08:16,719: Creating rockstor key...
oct. 23 17:08:16 PhilRock.home poetry[1595]: 2023-10-23 16:08:16,735: Singing cert with rockstor key...
oct. 23 17:08:16 PhilRock.home poetry[1595]: 2023-10-23 16:08:16,796: restarting nginx...
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,072: Checking for flash and Running flash optimizations if appropriate.
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,776: Updating the timezone from the system
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,777: system timezone = Europe/London
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,782: Updating sshd_config
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,782: Exception while updating sshd_config: [Errno 2] No such file or directory: '/etc/ssh/sshd_config'
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,782: --DB-- Tune Postgres --DB--
oct. 23 17:08:17 PhilRock.home poetry[1595]: 2023-10-23 16:08:17,783: --DB-- Running - Setup_host_based_auth
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,461: --DB-- Done with Setup_host_based_auth.
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,461: --DB-- Running - Reload_config
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,550: --DB-- Done with Reload_config.
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,551: --DB-- Running - PG_tune
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,708: --DB-- Done with PG_tune.
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,708: --DB-- Tune Postgres Done --DB--.
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,709: --DB-- Setup Databases --DB--
oct. 23 17:09:12 PhilRock.home poetry[1595]: 2023-10-23 16:09:12,709: --DB-- Running - drop_and_recreate
oct. 23 17:09:13 PhilRock.home poetry[1595]: 2023-10-23 16:09:13,608: --DB-- Done with drop_and_recreate.
oct. 23 17:09:13 PhilRock.home poetry[1595]: 2023-10-23 16:09:13,609: --DB-- Running - populate_storageadmin
oct. 23 17:09:15 PhilRock.home poetry[1595]: 2023-10-23 16:09:15,301: --DB-- Done with populate_storageadmin.
oct. 23 17:09:15 PhilRock.home poetry[1595]: 2023-10-23 16:09:15,302: --DB-- Running - populate_smartdb
oct. 23 17:09:15 PhilRock.home poetry[1595]: 2023-10-23 16:09:15,910: --DB-- Done with populate_smartdb.
oct. 23 17:09:15 PhilRock.home poetry[1595]: 2023-10-23 16:09:15,910: --DB-- Setup Databases Done --DB--.
oct. 23 17:09:15 PhilRock.home poetry[1595]: 2023-10-23 16:09:15,917: Running app database migrations...
oct. 23 17:09:37 PhilRock.home poetry[1595]: 2023-10-23 16:09:37,954: DB Migrations Done
oct. 23 17:09:37 PhilRock.home poetry[1595]: 2023-10-23 16:09:37,955: Running Django prep_db.
oct. 23 17:09:38 PhilRock.home poetry[1595]: 2023-10-23 16:09:38,731: Done
oct. 23 17:09:38 PhilRock.home poetry[1595]: 2023-10-23 16:09:38,731: Stopping firewalld...
oct. 23 17:09:39 PhilRock.home poetry[1595]: 2023-10-23 16:09:39,481: Firewalld stopped and disabled
oct. 23 17:09:39 PhilRock.home poetry[1595]: 2023-10-23 16:09:39,481: Enabling and Starting atd...
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,190: Atd enabled and started
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,526: Normalising on shellinaboxd service file
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,527: - established shellinaboxd.service file
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,527: Establishing Rockstor nginx service override file
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,527: /etc/systemd/system/nginx.service.d/30-rockstor-nginx-override.conf up-to-date.
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,528: /usr/lib/systemd/system/rockstor-pre.service up-to-date.
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,528: /usr/lib/systemd/system/rockstor.service up-to-date.
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,529: /usr/lib/systemd/system/rockstor-bootstrap.service up-to-date.
oct. 23 17:09:40 PhilRock.home poetry[1595]: 2023-10-23 16:09:40,529: Systemd config altered, running daemon-reload
oct. 23 17:09:42 PhilRock.home poetry[2304]: 2023-10-23 17:09:42,517 INFO Set uid to user 0 succeeded
oct. 23 17:09:42 PhilRock.home poetry[2304]: 2023-10-23 17:09:42,523 INFO RPC interface 'supervisor' initialized
oct. 23 17:09:42 PhilRock.home poetry[2304]: 2023-10-23 17:09:42,523 INFO supervisord started with pid 2304
oct. 23 17:09:43 PhilRock.home poetry[2304]: 2023-10-23 17:09:43,527 INFO spawned: 'gunicorn' with pid 2318
oct. 23 17:09:43 PhilRock.home poetry[2304]: 2023-10-23 17:09:43,529 INFO spawned: 'data-collector' with pid 2319
oct. 23 17:09:43 PhilRock.home poetry[2304]: 2023-10-23 17:09:43,532 INFO spawned: 'ztask-daemon' with pid 2320
oct. 23 17:09:45 PhilRock.home poetry[2304]: 2023-10-23 17:09:45,536 INFO success: data-collector entered RUNNING state, process has stayed up for > than 2 seconds (startsecs)
oct. 23 17:09:48 PhilRock.home poetry[2304]: 2023-10-23 17:09:48,540 INFO success: gunicorn entered RUNNING state, processhas stayed up for > than 5 seconds (startsecs)
oct. 23 17:09:53 PhilRock.home poetry[2304]: 2023-10-23 17:09:53,547 INFO success: ztask-daemon entered RUNNING state, process has stayed up for > than 10 seconds (startsecs)
oct. 23 17:46:51 PhilRock.home poetry[1251]: 2023-10-23 16:46:51,472: Checking for flash and Running flash optimizations if appropriate.
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,183: Updating the timezone from the system
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,183: system timezone = Europe/Paris
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,188: Changed timezone from Europe/London to Europe/Paris
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,189: Updating sshd_config
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,189: Exception while updating sshd_config: [Errno 2] No such file or directory: '/etc/ssh/sshd_config'
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,190: --DB-- Tune Postgres --DB--
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,190: --DB-- Running - Setup_host_based_auth
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,534: --DB-- Done with Setup_host_based_auth.
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,534: --DB-- Running - Reload_config
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,636: --DB-- Done with Reload_config.
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,636: --DB-- Running - PG_tune
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,810: --DB-- Done with PG_tune.
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,811: --DB-- Tune Postgres Done --DB--.
oct. 23 17:46:52 PhilRock.home poetry[1251]: 2023-10-23 16:46:52,811: Running app database migrations...
oct. 23 17:47:09 PhilRock.home poetry[1251]: 2023-10-23 16:47:09,416: DB Migrations Done
oct. 23 17:47:09 PhilRock.home poetry[1251]: 2023-10-23 16:47:09,416: Running Django prep_db.
oct. 23 17:47:10 PhilRock.home poetry[1251]: 2023-10-23 16:47:10,190: Done
oct. 23 17:47:10 PhilRock.home poetry[1251]: 2023-10-23 16:47:10,190: Stopping firewalld...
oct. 23 17:47:10 PhilRock.home poetry[1251]: 2023-10-23 16:47:10,833: Firewalld stopped and disabled
oct. 23 17:47:10 PhilRock.home poetry[1251]: 2023-10-23 16:47:10,833: Enabling and Starting atd...
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,454: Atd enabled and started
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,738: Normalising on shellinaboxd service file
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,739: - shellinaboxd.service already exists
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,740: Establishing Rockstor nginx service override file
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,740: /etc/systemd/system/nginx.service.d/30-rockstor-nginx-override.conf up-to-date.
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,741: /usr/lib/systemd/system/rockstor-pre.service up-to-date.
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,741: /usr/lib/systemd/system/rockstor.service up-to-date.
oct. 23 17:47:11 PhilRock.home poetry[1251]: 2023-10-23 16:47:11,742: /usr/lib/systemd/system/rockstor-bootstrap.service up-to-date.
oct. 23 17:47:13 PhilRock.home poetry[1614]: 2023-10-23 17:47:13,055 INFO Set uid to user 0 succeeded
oct. 23 17:47:13 PhilRock.home poetry[1614]: 2023-10-23 17:47:13,061 INFO RPC interface 'supervisor' initialized
oct. 23 17:47:13 PhilRock.home poetry[1614]: 2023-10-23 17:47:13,062 INFO supervisord started with pid 1614
oct. 23 17:47:14 PhilRock.home poetry[1614]: 2023-10-23 17:47:14,065 INFO spawned: 'gunicorn' with pid 1628
oct. 23 17:47:14 PhilRock.home poetry[1614]: 2023-10-23 17:47:14,067 INFO spawned: 'data-collector' with pid 1629
oct. 23 17:47:14 PhilRock.home poetry[1614]: 2023-10-23 17:47:14,070 INFO spawned: 'ztask-daemon' with pid 1630
oct. 23 17:47:16 PhilRock.home poetry[1614]: 2023-10-23 17:47:16,074 INFO success: data-collector entered RUNNING state, process has stayed up for > than 2 seconds (startsecs)
oct. 23 17:47:19 PhilRock.home poetry[1614]: 2023-10-23 17:47:19,078 INFO success: gunicorn entered RUNNING state, processhas stayed up for > than 5 seconds (startsecs)
oct. 23 17:47:24 PhilRock.home poetry[1614]: 2023-10-23 17:47:24,085 INFO success: ztask-daemon entered RUNNING state, process has stayed up for > than 10 seconds (startsecs)
oct. 23 17:53:10 PhilRock poetry[1614]: 2023-10-23 17:53:10,376 WARN received SIGTERM indicating exit request
oct. 23 17:53:10 PhilRock poetry[1614]: 2023-10-23 17:53:10,376 INFO waiting for data-collector, gunicorn, ztask-daemon todie
oct. 23 17:53:10 PhilRock poetry[1614]: 2023-10-23 17:53:10,395 INFO exited: data-collector (terminated by SIGTERM; not expected)
oct. 23 17:53:10 PhilRock poetry[1614]: 2023-10-23 17:53:10,518 INFO stopped: ztask-daemon (exit status 0)
oct. 23 17:53:10 PhilRock poetry[1614]: 2023-10-23 17:53:10,549 INFO exited: gunicorn (exit status 0; expected)
oct. 23 19:06:20 PhilRock poetry[1240]: Traceback (most recent call last):
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<string>", line 1, in <module>
oct. 23 19:06:20 PhilRock poetry[1240]:   File "/usr/lib64/python3.9/importlib/__init__.py", line 127, in import_module
oct. 23 19:06:20 PhilRock poetry[1240]:     return _bootstrap._gcd_import(name[level:], package, level)
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 972, in _find_and_load_unlocked
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
oct. 23 19:06:20 PhilRock poetry[1240]:   File "<frozen importlib._bootstrap>", line 984, in _find_and_load_unlocked
oct. 23 19:06:20 PhilRock poetry[1240]: ModuleNotFoundError: No module named 'scripts'

Hooverdan · October 23, 2023, 7:08pm

I’ve just tried the test channel upgrade from a freshly installed base iso (Leap 15.4, though) on a VM using the WebUI (my previous attempt seemed to have worked possibly because I got impatient, rebooted and then used zypper command line for updating the files, which, in turn also addressed the upgrade to the 5.0.5-1 version, but I didn’t pay too much attention to that, so doing this again, this time more slowly).

install stable 4.5.8-0 from iso into VM - successful
basic config via WebUI (admin user and host name set up)
activate testing channel
select start upgrade for 5.0.5-0
wait … some more waiting, after countdown clock expires (and notice that it was still updating)
version didn’t change, shortly thereafter WebUI not accessible anymore
eventually lost ssh access via PuTTY, too
logged into console on VM and ran systemctl restart network since myip only gave me the default docker network IP anymore (this might be a quirk I’ve experienced on VirtualBox installs, so I’m not too worried about that.
WebUI not accessible either.

I have noticed that the poetry-install file only shows the original installation info.

A reboot restored the WebUI access, but no version change.
Additional Info:
After reboot, Rockstor indicates also non-Rockstor package updates available. Using WebUI to install those.
Another reboot, still offering the update to 5.0.5-0 - triggering it again.
this time, the update is occurring, the poetry-install.txt has an updated time stamp as well as new content indicating that the upgrade to 5.0.5-0 is happening.
and completed the upgrade

Flox · October 23, 2023, 7:09pm

That one is on me… sorry. I forgot that we do not add poetry to $PATH on RPM installs.
The correct command would be:

cd /opt/rockstor
/root/.local/bin/poetry install

If it tells you that something does not need updating, then you can wipe the venv (rm -rf /opt/rockstor/.venv) and run the command above again.

philuser · October 23, 2023, 7:21pm

Don’t worry @Flox, little oversights happen to us all

For the instruction, it’s been more than 10min since I launched the command, so I’m left with :

PhilRock:/opt/rockstor # /root/.local/bin/poetry install

Installing dependencies from lock file

Package operations: 16 installs, 0 updates, 0 removals

• Installing dbus-python (1.2.18): Pending...
• Installing distro (1.8.0): Pending...
• Installing django-oauth-toolkit (1.1.2): Pending...
• Installing django-pipeline (2.1.0): Pending...
• Installing djangorestframework (3.13.1): Pending...
• Installing gevent (23.9.1): Pending...
• Installing gunicorn (21.2.0): Pending...
• Installing huey (2.3.0): Pending...

no evolution, the sequence is frozen, but not the station on which I have other ssh sessions, notably with a journalctl -f.

Ok, this has just evolved

PhilRock:/opt/rockstor # /root/.local/bin/poetry install

Installing dependencies from lock file

Package operations: 16 installs, 0 updates, 0 removals

• Installing dbus-python (1.2.18)
• Installing distro (1.8.0)
• Installing django-oauth-toolkit (1.1.2)
• Installing django-pipeline (2.1.0)
• Installing djangorestframework (3.13.1)
• Installing gevent (23.9.1)
• Installing gunicorn (21.2.0)
• Installing huey (2.3.0)
• Installing psutil (5.9.4): Pending...
• Installing psycogreen (1.0): Pending...
• Installing psycopg2 (2.8.6): Pending...
• Installing python-socketio (5.9.0): Pending...
• Installing pyzmq (19.0.2): Pending...
• Installing six (1.16.0): Pending...
• Installing supervisor (4.2.4): Pending...
• Installing urlobject (2.1.1): Pending...

so I’m waiting patiently for the rest

phillxnet · October 23, 2023, 7:27pm

@philuser Thanks for your patience here, much appreciated.

This poetry install can take a while with a slower internet, or maybe PyPi where all these packages come form, is having a bad day. This may explain the time-outs etc you have been having. It can take only a few minutes. Another limitation is CPU: we build some of these packages. Also note the notes on the download page re the Tumbleweed download.

No worries re the Py3.10, that is default in TW and we are not there yet (but soon) however again we pretty much independant of the default Python on the system and have poetry build our .venv environment under a specific Python version: 3.9 across the board currently in testing channel.

Hope that helps if only for context.