I used the opposite strategy. One die for the initiative, and three die for defense. Boost the one you don't use. It involves a little luck, and if you get defeated, your dice get smaller, but that only happened with the final boss when they had 4 speed