Wow I enjoyed this a lot more than I expected to! Really clever puzzle mechanic, great job!
It took me longer than I would like to admit to figure out that you can use the empty ones to hold the key though :')
Haha glad you enjoyed!