Thanks to everyone for the help.
Figuring out stand-alone Renoise was bit too much for me, but I got around to write how to make minimal Renoise linux with low latency: