Thanks for playing!
Yeah, limiting your options is essentially their entire point, and so long as there aren't too many of them at the same time, they should be priority targets, but manageable threats.
