Is there an inversion of the Bandwagon Fallacy?

Not necessarily an opposite. I mean in a sense that people justify an argument not on the insistence that it isn't popular, but the insistence that a counterargument is popular, whether or not that claim is dubious.