In other words, I don't have an intuitive explanation on how the logic works, lol.
I put a lot of effort in manually tuning the UMAP hyperparameters and qualitatively assess if it made sense to me. This version is the best I got after ~8hs of fiddling with it.