You can only grapple in certain places (the bright yellow squares), as otherwise the game would be completely broken. Are you sure you were doing it right?