I had the same problem recently. The version of openssl-libs installed is 1.0 and the newer nginx wants 1.1 of the libs.
Install openssl11-libs but not openssl11 as that could create problems with other dependencies. Restart after the install and see if the Rockstor UI comes up.
Mine has been running for a few days since without problems.