Is it okay if we make our game a "fan game," like made in a known universe? Or do we have to own the IP/Copyright on everything? Thanks!

You can make any game you like, as long as you have permission to use the assets and it incorporates the theme.