Hi, this is my first game jam so this is probably a stupid question, but if I buy asset packs off the Unreal Engine Marketplace, is that okay?

Yes, absolutely!