Oh my bad, you're totally right - when I did right-click -> Open Image in New Tab it displayed with the white background so I assumed it was baked into the image, but when I save it I see it's actually transparent. Nice :)