I think you've got two solutions, one simple and one more complex.
Simple: you're a wizard with magic crystals. They can absorb and transfer energy into themselves.
Complex: the dice represent motivation/inspiration. Finding loot and making progress increase your motivation. Fighting and overcoming costs motivation. Each transaction could be roleplayed depending on the number involved. And resting let's you reroll your motivations.