A Finite State Machine is a set of frames and apropriate actions each entity can have. It's basically a way to control enemy, decoration or weapon frames and behaviour to some extend.
In math terms it's a connected graph.