Ah, could be because I use the mouse then? I used my thumb button for it, and that didn't work.
Likely yes. See if you can use your driver software to have the thumb button send a key instead of a mouse-click. That's how I do it with my Logitech MX Revolution mouse.