I feel you. I got 9 ratings and from what I gathered only 6 of them have actually played through my game.
I don't really think that game jams are a good way to boost awareness of your game. It's difficult to get any long term attention here. If there is a jam that gives people awareness of you, then that would be GMTK Game Jam. When people rate games they don't really put a long time on them - and certainly not on the creator. You should however market it more. Put it everywhere you can - even if it may sound cheesy. On your game's itch.io page you could put a link to it. Also on your profile page. I even saw people putting their games' titles in their nicknames on discord.
Your game looks promising at a first glance. What about YouTube? Twitter? Discord? Are you making devlogs of any kind? That could help you gain awareness. Like making a video - 2 years of making my dream game. It is cheesy but it gives people awareness that a game like this exists and THAT is important. Maybe ask some streamers to playtest your games. A single playtest like this would bring a lot more people than a game jam entry would. A game jam brings like a 100 ratings at most (I don't even know what percentage of those ratings is even real but anything above that is wishful thinking at times).
No one likes marketting but it's a crucial part of making indie titles. You said that you started game dev on the Brackeys Game Jam? That's great! Use that. Brackeys game jam is in September. Admittedly it starts after the release of your game but thats's also good. You could for example say
If you enjoyed it take a look at my dream game that just released: Castle of Lord Velimir on Steam.
Good luck, in any case!
P.S.: I suggest you watch this video. That's where some of that advice comes from.