Yeah, you need to click on them either in your inventory or above the thing you want to take from. E is only for talking to things when you both have the speak action
