Pretty simple question, would it be against the rules to use old recordings of public domain music in my game instead of making my own?

As far as it's public domain, you should be safe