It was mainly the lives system and having to start again from the beginning of the level after running out of lives. I understand that the original Castlevania games were not that easy but it can be frustrating to have to restart.
Thanks for the feedback. I think adding some accessibility options might be a great start. More checkpoints (I.e every room) and weakened enemies.