EDIT: This turned out to be an issue with MariaDB; restoring an earlier snapshot got Owncloud up and running again. (I’m currently in the process of fixing a bunch of conflicts, since the snapshot was a month old; guess I’ll be setting up more frequent snapshots for my MariaDB share from here on out.)
I’m still not sure what caused the problem, and if anyone has any ideas I’d still be interested in hearing them in case this ever happens again (or happens to anybody else). Thanks.
Original post:
Hi there,
I’ve written a little bit about my recent troubles with the owncloud-official Rock-On over in the Owncloud SSL Offical Image Guide thread, but I figured it might be better to start a new thread in Troubleshooting instead.
Basically, Owncloud quit working shortly after I upgraded Rockstor to 3.8.15, though the timing could be a coincidence; when I open the Owncloud login page in my browser, I just get a blank file (which my reading indicates means there’s a 500 error).
It took me a little bit to figure out where the logs are (just good ol’ /var/log/messages, as it turns out); now that I’ve found them, I’m seeing a bunch of error messages that look similar to this one:
Dec 9 10:04:17 rockstor docker/60088a924cd1[4394]: chown: changing ownership of ‘/config/.mariadata_201612060342/databases/ownclouddb’: Read-only file systemThis seems like it’s probably what’s causing the problem (though I don’t know for sure; maybe I’m barking up the wrong tree). The issue seems similar to the one described in the Sudden readonly shares thread, which unfortunately doesn’t have any responses.
I expect the fix here should be simple but I haven’t been able to work out what it is; I’m not new to Linux but I am new to Rockstor and Docker, I’m not sure why the FS is mounting RO, and I don’t know what to do to fix it. Is it just a matter of doing a simple fsck fix?
Any suggestions are appreciated. Thanks!
–
ETA: Could be I’m barking up the wrong tree and the problem’s not with OC at all, but mariadb? Here’s the output of docker ps:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
9cff78430e51 owncloud "/entrypoint.sh apach" 3 months ago Up 39 hours 0.0.0.0:8087->80/tcp, 0.0.0.0:8087->80/udp owncloud-official
60088a924cd1 linuxserver/mariadb "/sbin/my_init" 3 months ago Restarting (1) 10 hours ago 0.0.0.0:3306->3306/tcp linuxserver-mariadbOutput of /var/log/messages when I try to restart mariadb:
Dec 10 11:25:48 rockstor systemd: Starting docker container 60088a924cd1fa298a217676c03fda43b1e41aeedea3ae0575f34aa66f6f7332.
Dec 10 11:25:48 rockstor kernel: docker0: port 2(veth4bab59f) entered disabled state
Dec 10 11:25:48 rockstor NetworkManager[1960]: (veth4bab59f): link disconnected
Dec 10 11:25:48 rockstor kernel: veth26ad70c: renamed from eth0
Dec 10 11:25:48 rockstor NetworkManager[1960]: (veth26ad70c): failed to find device 10 'veth26ad70c' with udev
Dec 10 11:25:48 rockstor NetworkManager[1960]: (veth26ad70c): new Veth device (carrier: OFF, driver: 'veth', ifindex: 10)
Dec 10 11:25:48 rockstor avahi-daemon[1967]: Withdrawing workstation service for veth26ad70c.
Dec 10 11:25:48 rockstor kernel: eth0: renamed from veth26ad70c
Dec 10 11:25:49 rockstor kernel: docker0: port 2(veth4bab59f) entered blocking state
Dec 10 11:25:49 rockstor kernel: docker0: port 2(veth4bab59f) entered forwarding state
Dec 10 11:25:49 rockstor NetworkManager[1960]: (veth26ad70c): failed to disable userspace IPv6LL address handling
Dec 10 11:25:49 rockstor NetworkManager[1960]: (veth4bab59f): link connected
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]:
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: -------------------------------------
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: _ _ _
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: | |___| (_) ___
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: | / __| | |/ _ \
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: | \__ \ | | (_) |
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: |_|___/ |_|\___/
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: |_|
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]:
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: Brought to you by linuxserver.io
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: We do accept donations at:
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: https://www.linuxserver.io/donations
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: -------------------------------------
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: GID/UID
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: -------------------------------------
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: User uid: 1001
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: User gid: 1001
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]: -------------------------------------
Dec 10 11:25:49 rockstor docker/60088a924cd1[4394]:
Dec 10 11:25:49 rockstor systemd: Stopped docker container 60088a924cd1fa298a217676c03fda43b1e41aeedea3ae0575f34aa66f6f7332.
Dec 10 11:25:49 rockstor systemd: Stopping docker container 60088a924cd1fa298a217676c03fda43b1e41aeedea3ae0575f34aa66f6f7332.
Dec 10 11:25:57 rockstor journal: Suppressed 707 messages from /system.slice/docker.service
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.335567 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.335700 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): Error while reading greeting packet. PID=11 in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.346008 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.346080 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): Error while reading greeting packet. PID=11 in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.357400 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.357452 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): Error while reading greeting packet. PID=11 in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.365544 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.365624 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): Error while reading greeting packet. PID=11 in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.370434 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Fatal error: Uncaught exception 'Doctrine\\DBAL\\DBALException' with message 'Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2006] MySQL server has gone away' in /var/www/html/lib/private/DB/Connection.php:58\nStack trace:\n#0 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(429): OC\\DB\\Connection->connect()\n#1 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(389): Doctrine\\DBAL\\Connection->getDatabasePlatformVersion()\n#2 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(328): Doctrine\\DBAL\\Connection->detectDatabasePlatform()\n#3 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(621): Doctrine\\DBAL\\Connection->getDatabasePlatform()\n#4 /var/www/html/lib/private/DB/Connection.php(141): Doctrine\\DBAL\\Connection->setTransactionIsolation(2)\n#5 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/DriverManager.php(172): OC\\DB\\Connection->__construct(Array, Object(Doctrine\\DBAL\\Driver\\PDOMySql\\Driver), Object(Doct in /var/www/html/lib/private/DB/Connection.php on line 58
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.375446 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.375504 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Warning: PDO::__construct(): Error while reading greeting packet. PID=11 in /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php on line 43
Dec 10 11:25:57 rockstor docker/9cff78430e51[4394]: [Sat Dec 10 11:25:57.382855 2016] [:error] [pid 11] [client 192.168.2.15:51738] PHP Fatal error: Uncaught exception 'Doctrine\\DBAL\\DBALException' with message 'Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2006] MySQL server has gone away' in /var/www/html/lib/private/DB/Connection.php:58\nStack trace:\n#0 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(429): OC\\DB\\Connection->connect()\n#1 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(389): Doctrine\\DBAL\\Connection->getDatabasePlatformVersion()\n#2 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(328): Doctrine\\DBAL\\Connection->detectDatabasePlatform()\n#3 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(621): Doctrine\\DBAL\\Connection->getDatabasePlatform()\n#4 /var/www/html/lib/private/DB/Connection.php(141): Doctrine\\DBAL\\Connection->setTransactionIsolation(2)\n#5 /var/www/html/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/DriverManager.php(172): OC\\DB\\Connection->__construct(Array, Object(Doctrine\\DBAL\\Driver\\PDOMySql\\Driver), Object(Doct in /var/www/html/lib/private/DB/Connection.php on line 58So I’m not sure what the next step is, what’s preventing the MariaDB container from starting, or how to look for the cause. I might try restoring an earlier snapshot of my mariadb-data share and see if that makes any difference; if it does, I’ll update the post again.