You can lose HP when you go in an area with enough pressure to damage you, the amount of pressure you can withstand is determined by your (hidden) level. Gathering 10 fishes will make you level up so you probably went to level 2 before going deep enough.
We had some goals in mind but due to time constraints we could really implement them, I'm planning to do an update after the jam to fix some stuff and add something.