This is strange. I just tested with my Remote SL, and here it works fine (on pads, buttons and sliders).
Are you sure that you have de-selected your controller from the MIDI input in the Renoise prefs? When running Duplex, you need to let it take over control…
If this is not solving your issue, you could perhaps share the configuration, allow me to take a closer look?
I guess you want something like the Effect, but with the ability to display specific device(s). Ah yes, this is why the roamingDSP class was invented - I too needed a way to lock mappings. Not sure how to best deal with this, but let me think about it.
Btw: Very nice & sturdy looking controller. Congrats!