You can also right click -> Open the app in Finder. macOS will show the same dialog, but it will have an Allow button on it.