The maps were made based of midi files directly extracted by the musicians and the notes/bpm changes correspond directly to the notes in the song.
The only possible explanation I can think of is that your device is too slow which is creating that feeling.
"Would love if the difficulty was toned down a bit across the board" That's a skill issue brother!