That seems to be true of any channel strip, or really any complex plugin for that matter, so perhaps the question is would that time be better invested elsewhere?
Do you think that a plugin like Waves Vocal Rider or Hornet Autogain would help balance the gain feeding one of the automix plugins?