So here's my suggestion.

Add a button exclusively for adding/replacing plugins. (the cross in the box beside the "No Plug-in" box).

when choosing a plugin, a menu comes up instead of windows explorer. In here you can add plugins via Windows explorer. This menu will remember your collection of plugins for easier and faster access.
Can we see something like in a future release?