Sure, see these two sections from the documentation, which is also accessible from within Playscii if you press F1: http://vectorpoem.com/playscii/howto_art.html#customcharsets
Creating a custom character set is a bit trickier than creating a custom palette, but that should explain what's needed.