I agree pretty much always except when I was doing the 24hr race last year. I was trying to go as fast as I could while also conserving energy and I was switching between map 1 and 3 often. I had a hard time switching fast without mashing more than one of the buttons mostly because bumps and stuff were making it challenging. It wasn't annoying enough for me to make a solution, though if someone else is looking for one the Mountainbike shift levers would make the most sense to me.
Oh that totally makes sense! I have not ridden mine enough to get that tricky with it haha.