You cannot install any APK over 2GB. You may have downloaded something larger than that from the Play Store, because there you can bundle multiple file packages together, but Android has a hard limit on individual APK installations.
Storage is a completely different thing and wasn't mentioned.