It's running in real time.
Cool! Is there unity frameworks or do you have to run python from unity or how do you do this?
there is an api called Unity ML-Agents, which allows to do this.