That's why the leader line offset is offered.
BUT... I do not think you can MOVE the offset, and you cannot stagger the numbers, they are all stacked. It would be good to be able to make the offset move in or out to allow a bit more clarity in just where it is going. Now, if you try to move a number or offset,, the entire set of dimensions moves in or out.
Moving the offset, and/or being able to pull out numbers independently to stagger them would be very useful.
Yes, at SOME point it gets ridiculous, and a close view is needed. Possibly a separate broken view that allows that area to be shown larger..... but keeps the ability to tie the dims to the drawing....