Verbal

The use of "verbal" or "verbally" when people mean "oral" drives me nuts. My cranky but usually silent thought: Well, yes, if they used words it would indeed have been verbal but was it spoken or written? Am I alone in being peeved about this?