After pressing E to read the note, I couldn't find any way to close the note except pressing E again, which would replay the hand moving upward animation and I'd just end up reading the note again.
It's in the description: TAB to close letters
