I think this is so cute! When I heard it was going to be a fandub of a drama CD I didn't know how it would go, but I think it works out well. I read through the whole page just to find out if there was a schedule and I saw people were rating this low because they didn't understand that. Which is awful. Something you might do is advertise it as a kinetic visual novel? It would also need a little explaining due to branching routes, but in large part there's no choices, so that would probably be a more accurate explanation. Of course, it's just a suggestion and it's up to you to brand as you see fit! (God, I feel like I'm horrible at explaining what's going on in my head)
If/when you get to the next story, I'd love to help out! I'm not a great voice actor, but when I was with my ex she told me I had a pretty good yandere voice. But keep your head up, you're doing great work. (I don't remember if I commented on other projects or this one before-- I feel like I must have but I am terribly forgetful.)