The responsiveness when jamming out a melody on small buffer size is something wonderful.
Unfortunately playing a song with all tracks require larger buffer size.
Would it be possible to set a different buffer size for when a song isn’t playing?
When I wrote this idea I didn’t have the Plugin Delay Compensation in mind as I just opened my “blank” template, unfortunately this blank template has a master chain that even when turned off add loads of latency because of the plugin delay compensation, be aware that this might not be a great thing to have.
A dynamic buffer is just a small drop and probably not worth any effort, instead maybe look into a solution to disable PDC for effects that are turned off the entire song, I would turn on such a feature.