Oh, I should have read your question more thoroughly.
Having the note velocity control the attack phase of a (modulation) ADHSR device - shouldn’t that be dealt with entirely inside the modulation chain? At least, for me it was the mention of macros that threw me off track
Check out this topic (“modulating modulation”), an idea that get a big +1 from as well.