This should now be fixed in v0.40!
Will probably try to make it so that you can transfer either 1 item, or the whole stack by holding Shift in the next version, since there's probably times when you don't want to bring the full stack with you.
