Annoying gui 'bug' with pattern matrix

I’ve set the keyboard shortcut for PE:Navigation:Focus Pattern Matrix to the Apps key. And the same for the ‘vice versa’ command from PM back to PE. So that works really well with another shortcut to hide PM. Only thing that annoys me is, when you keep Follow on, PM will hold the selection from when you first switched to PM. So pressing enter will toggle that block where you once ‘came from’ - this is of course because also the mouse can select multiple blocks and even tracks/patterns not in a straight row…
I don’t know, is there any way really this behaviour can be improved?