Fishes kill indeed, but there is a trick. Fishes should not kill you if you hide behind algae while they collide with you (see attached image below). Another tip: if you see algae somewhere, it means there might be at least one fish that should pass its way around it. Annoying fishes, haha.
Hope this help, and thank you very much for playing!