A Pair of Pants

Why do we have to buy pairs of pants?  Can't I just purchase one?  Why don't we say "pair of shirts"?