you can get there, you just can't get some (uh, not very useful) loot out of it. from some point of time you can even recruit Warlock to your team with your butt, and no Charisma. Which makes it even less important as a stat.
