Thanks ! Basically, there is a normal Unity scene running in the background with a lowdef camera whose the output is redirected to a texture so I can access the RGB value of each pixel. A function then map each pixel color to the ascii characters that are displayed.