I managed to fix the issue!
Turns out there was a problem with how the characters were listed.
Basically I accidentally left some dummy characters active on the scene. These characters have no visible components, nor colliders. That's what is on the screenshot.
I removed them, so the system should work now :)
I'll upload the new build asap.