I'm sorry, I don't know how to do it. If you're sure you downloaded the Mac version, consider looking for fixes for MacOS Monterey in regards to "Ren'Py" - this is the engine Roadwarden uses.
Is it possible that the mac version has a 32bit executable in it ? That might be the reason. Is it possible that you package another mac version with a 64bit executable in it then ?
The issue was that the executable in the .app package did not have the execution flags/permission set. So I fixed it for myself and it is running now. Strange ...