Column storageadmin_share.pqgroup_rusage does not existLINE 1: ...n_share"."rusage", "storageadmin_share"."eusage", "storagead... ^

[Flyer (Mirko Arena)]

Hi @zgyivi,
did you have also an update after downgrade?
Mirko

[suman (suman chakravartula)]

Assuming you are on 3.8.16-12 now, Could you capture the entire output of yum update rockstor? This output will have clues, if the problem appears again.

[zgyivi (Zoltan Gyivicsan)]

Update from 3.8.16-12 to 3.8.16-13 is OK.
Sorry @suman I did not capture the update output, as I just read your post, it did look smooth, no unusual message and I did not get the error message after reboot.
Previously I updated from 3.8.15 to 3.8.16-13 directly, that caused the error.
It seems you have a some step in 3.8.16-12 release what is fixing the database, but it is not included in 3.8.16-13.
Zoltan

[kriz2 (Christo Claassen)]

Hi.
I just had the same issue as zgyivi, with a similar upgrade path (3.8.15 -> 3.8.16-14). Downgrading to -12 and then upgrading to -14 again worked for me.
@suman I’m going to set up a similar server next week and will try to capture the output from the 3.8.15 -> 3.8.16-14. Let me know whether I need to capture anything extra.

[gkadillak]

I’ve been having the same issue too. Just updated to 3.8.16-15 and had the same error for the column. I updated to 3.8.16-15 and now I have the following stacktrace

            Traceback (most recent call last):
  File "/opt/rockstor/src/rockstor/rest_framework_custom/generic_view.py", line 41, in _handle_exception
    yield
  File "/opt/rockstor/src/rockstor/storageadmin/views/user.py", line 106, in get_queryset
    return combined_users()
  File "/opt/rockstor/src/rockstor/storageadmin/views/ug_helpers.py", line 69, in combined_users
    temp_uo.pincard_allowed, temp_uo.has_pincard = pincard_states(temp_uo)  # noqa E501
  File "/opt/rockstor/src/rockstor/system/pinmanager.py", line 146, in pincard_states
    pincard_present = has_pincard(user)
  File "/opt/rockstor/src/rockstor/system/pinmanager.py", line 129, in has_pincard
    pins = Pincard.objects.filter(user=int(uid_field)).count()
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/models/query.py", line 318, in count
    return self.query.get_count(using=self.db)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/models/sql/query.py", line 466, in get_count
    number = obj.get_aggregation(using, ['__count'])['__count']
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/models/sql/query.py", line 447, in get_aggregation
    result = compiler.execute_sql(SINGLE)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/models/sql/compiler.py", line 840, in execute_sql
    cursor.execute(sql, params)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/backends/utils.py", line 64, in execute
    return self.cursor.execute(sql, params)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/utils.py", line 98, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/opt/rockstor/eggs/Django-1.8.16-py2.7.egg/django/db/backends/utils.py", line 64, in execute
    return self.cursor.execute(sql, params)
ProgrammingError: relation "storageadmin_pincard" does not exist
LINE 1: SELECT COUNT(*) AS "__count" FROM "storageadmin_pincard" WHE...

I’m trying yum downgrade rockstor right now and capturing the output. Just want to help fix this bug

[phillxnet (Philip Guyton)]

@gkadillak Hello again.
Are you sure your report is the same error as in this issues we have:

@zgyivi

storageadmin_share.pqgroup_rusage does not exist

where as in your log we have:

@gkadillak

ProgrammingError: relation “storageadmin_pincard” does not exist

which looks more like:

Missing DB table, causing an error on every page

Hi @rockmar. It’s understandable why you wanted to start with 3.8-12, but could you install from 3.8.15 iso so that you get all necessary db schema changes the old way and then update to the latest? Any system being updated to 3.8.15-X should be updated from 3.8.15. When making django 1.8 migration I did think of the possibility of some users being on older versions. To provide a smooth upgrade path from <3.8.15 to latest would involve putting a lot of convoluted logic and then deprecating it l…

and

Upgrading to 3.8.16 from 3.8-14 or before? Read this

This guide is for subscribers to Stable updates. Rockstor upgrade from 3.8.15 to the latest release, 3.8.16 is simple. Just click on the update notification in the UI and be on your way. However, some users tend to be on prior versions and may try to upgrade directly to 3.8.16 and this will most likely break. We sent out an e-mail in advance of releasing 3.8.16 to get your system upgraded to 3.8.15 for a smooth transition. But it’s totally understandable some users couldn’t do that in time. This…

which were caused by a db migration tool change that meant no direct updates from Rockstor versions prior to 3.8.15, ie you had to install 3.8.15 as an interim step. However this newer issue has been seen (though rarely) when updated from rockstor-3.8.16-10.x86_64 to rockstor-3.8.16-12.x86_64.

That is in:
EDIT: corrected to link to 3.8.16-11 (not -10)

Dev log for 3.9.0

3.8.16-11 is now available! We fixed Share size reporting bug and made an improvement to the UI. @Flyer and @phillxnet have each contributed one pull request each. Thank you both!

@Flyer added the issue specific db field in:

Share Usage reporting right sizes

via:
commit 70ce761574f71be98b1a3df8f2f7a048ffc453b2
Share Usage reporting right sizes by MFlyer · Pull Request #1625 · rockstor/rockstor-core · GitHub
I’m currently looking into this but it seems initially that this is the db migration that fails to apply in some cases, resulting in the report subject of this thread.

I may have this all wrong so do share any findings corrections as it would be great to get this one sorted.

[phillxnet (Philip Guyton)]

Sorry folks, linked to wrong release version. Have now edited that last post to point to:

Dev log for 3.9.0

3.8.16-11 is now available! We fixed Share size reporting bug and made an improvement to the UI. @Flyer and @phillxnet have each contributed one pull request each. Thank you both!

for when
pqgroup_eusage and pqgroup_rusage were added.

[gkadillak]

Thanks @phillxnet

[kriz2 (Christo Claassen)]

Hi @suman . There is no warnings or anything strange in the output of the update. I can upload the log files somewhere if you want it, but I don’t think there is anything valuable in them, as they don’t show any kind of problem.

[Learning2NAS]

Just dropping by to confirm that this issue still exists. I did an update from 3.8.15 to 3.8.16-16 and ended up with the error described above. I rolled back, one version at a time, using yum downgrade rockstor and the error resolved itself when I got to 3.8.16-12.

So glad this thread exists! Thanks guys.

[wraeuk]

I had this occur on my stable machine when it auto-updated to 3.9.0 this morning
Appears to be working after a yum downgrade rockstor (which put it to 3.8.16) and then update + reboot from the gui

[dcypher]

Awesome! Fixed my problem! Thank you!

[Zak.Ford]

Just want to chime in I had the same problem going from 3.8.15-9 to 3.8.16-16.

yum upgrade rockstor-3.8.16-16 ### upgrade from 3.8.15-9. Post-Install RPM Failure!!!
systemctl restart rockstor-pre rockstor rockstor-bootstrap ### FAILURE!!!

I downgraded to 3.8.16-12 (from 3.8.16-16) first, restarted Rockstor, then upgraded back to 3.8.16-16. That seemed to work this time.

yum downgrade rockstor-3.8.16-12
systemctl restart rockstor-pre rockstor rockstor-bootstrap
yum upgrade rockstor-3.8.16-16
systemctl restart rockstor-pre rockstor rockstor-bootstrap

[Flyer (Mirko Arena)]

Hi all, this is a copy&paste message on multiple forum threads:

checking over a Github ad hoc issue, any news on this after last Rockstor update?

On my side: some checks required with Rock-ons share usage (probably docker related), but no blocking errors like missing db fields, etc

Thanks

[chicago]

I have this problem too after auto upgrading to 3.9.0, trying to downgrade. But has any solution been found? I really don’t like being on old releases.

[suman (suman chakravartula)]

The root cause of this issue is a bug in our schema migration logic. I fixed it in https://github.com/rockstor/rockstor-core/pull/1694 which went into 3.9.0-4

[brad (Brad Crawford)]

hi @suman - i am on 3.9.0-5 and still have the issue listed:

Houston, we’ve had a problem.

column storageadmin_share.pqgroup_rusage does not exist LINE 1: …n_share".“rusage”, “storageadmin_share”.“eusage”, "storagead… ^

I have been a Stable Update Channel user - but after experiencing this issue - switched to Testing Updates channel to access the 0-4 release - this has actually provided me the 0-5 release but the error persists.

[grizzly]

Upgraded from 3.8 to 3.9 (stable) here and had this problem. Tried:
yum downgrade rockstor-3.8.16-12
but errored “No package rockstor-3.8.16-12 available”

Then:
yum downgrade rockstor
systemctl restart rockstor-pre rockstor rockstor-bootstrap
But errored:

Job for rockstor-bootstrap.service failed because the control process exited with error code. See “systemctl status rockstor-bootstrap.service” … for details
Bootstrap service won’t start:
[root@nas ~]# systemctl status rockstor-bootstrap.service
● rockstor-bootstrap.service - Rockstor bootstrapping tasks
Loaded: loaded (/etc/systemd/system/rockstor-bootstrap.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Mon 2017-04-17 23:04:23 BST; 1min 12s ago
Process: 17144 ExecStart=/opt/rockstor/bin/bootstrap (code=exited, status=1/FAILURE)
Main PID: 17144 (code=exited, status=1/FAILURE)

Then upgraded back to 3.9 using webui, which got rid of the GUI errors. However rockstor-bootstrap service still won’t start and my main NFS share couldn’t be found (samba was fine). NFS service was started (tried restarting it). Webui showed

Unknown internal error doing a POST to /api/sm/services/rockstor-bootstrap/start

Rebooted, same state (except clock became correct timezone). Tried to recreate NFS share I needed but pressing trash icon did nothing. So just created a new NFS share for the same share, but with * for host and nfs client instead of the FQDN of the host that needs it. Now can access this share. But not a smooth upgrade experience, and there are still glitches:

1. Can’t delete NFS shares
2. Bootstrap service is stopped - should this be started? If so, how?
3. Should I temporarily change to testing updates to get to -05, then back onto stable?

[suman (suman chakravartula)]

hi @suman - i am on 3.9.0-5 and still have the issue listed:

Could you reply with the output of systemctl status -l rockstor-pre command?

[suman (suman chakravartula)]

Should I temporarily change to testing updates to get to -05, then back onto stable?

Really sorry this nasty db migration bug go into stable. The easiest way to fix it is to update to -05, but also make sure rockstor-pre service has restarted. After update, please capture the output of systemctl status -l rockstor-pre and if it has not restarted/started recently, go ahead and restart it with systemctl restart rockstor-pre. If still having problems, reply with output of systemctl status -l rockstor-pre rockstor rockstor-bootstrap