Yes, it should work as you described. Maybe there is an issue with native file dialog on Mac in case of you can try to disabled native dialog in settings/interface :
