Is it possible to remove/delete a building during construction and get back the ressource ?

No. The better option is to finish the building and remove it, because when you select it again from the menu and you will place it it will be immediately completed.