It might just be a timeout issue, that has been experienced in a couple of other scenarios (but unfortunately also not really conclusively been resolved):
wondering whether you’re seeing some similar messages around WORKER TIMEOUT …
What is the docker version you have? On mine it shows:
~ # docker --version
Docker version 24.0.5-ce, build a61e2b4c9