If the game logic is in Lisp I don't see the problem. You'll need to use foreign libraries for any project, even if it's just SDL or OpenGL bindings.