@dzmaster welcome to the Rockstor community.
RAID 5/6 is still supported, just not recommended, and now you have to jump through a couple of hoops to enable it.
For reference, you can read through this thread, where @philip outlines the options a bit more:
btrfs itself recommends RAID1c3 as a possible replacement for RAID6 with the space caveat:
https://btrfs.readthedocs.io/en/latest/mkfs.btrfs.html#profiles
Note 4: Since kernel 5.5 it’s possible to use RAID1C3 as replacement for RAID6, higher space cost but reliable.
The entire concept of the Rockstor appliance is built on btrfs, rather than being a NAS appliance under which you’d manage “any type” of filesystem/RAID approach. So, the likelihood of supporting ZFS as the NAS filesystem is probably nil.
There continues to be some movement on the RAID5/6 space in development, but since that has been going on for a number of years, it might take another couple of years for it to be determined to be stable/OK.
Of course, as seen on some other discussions on this forum, the risk of RAID5/6 diminishes both based on use case (e.g. mostly read operations like on a media server with more sparse write activities) and setup (e.g. having a UPS to ensure clean shutdown). And, as always, the NAS itself will not be a replacement for good backups, but that is now more of a philosophical debate than a technical one.