Thank You Phill!
This is exactly what I was searching for, being able to see debug gizmos in builds is really helpful.