I have been working on this:
Not quite the same thing, but I encourage you to read documentation, tackle through tutorials and just try to connect them : D
I managed to connect renoise and blender with very little knowledge about coding. OSC, Lua and especially Pure data are all pretty simple and well documented, in that sense that total newbie can do something with them with little effort.