The issue was that the executable in the .app package did not have the execution flags/permission set. So I fixed it for myself and it is running now. Strange ...
How did you fix it? I'm on Ventura.
Open terminal
cd into .app package
cd Contents
cd MacOS
chmod +x Roadwarden
Run and enjoy
Thanks!