Lol I didn't realize you could swipe the heart! A simple fix could be putting the heart on a card. That way the player gets the hint that it is swipeable.
