Renoise Midi Delay In Rewire

So I’m trying to do a remix and I’ve got all the wav files loaded up in Reaper. I open a rewire channe for Renoise and load up a drum loop to chop in the instrument editor. I finish chopping everything, but then when I go to play the individual hits from my midi keyboard I’m getting serious latency. Anyone else have this problem and how can I fix it?