I would prefer this:
If there is 1 selection, the selection is cleared. This lets you quickly mitigate misclicks for the first selection.
If there is 2 selection, left clicking in empty space will clear the 2nd selection, but right clicking in empty space will give a drop list with "apply" in...