Here's another great hoaxbusters site: http://www.snopes.com/crime/warnings/creditcard.asp

Their conclusion is the story is probably hearsay that has been circulating for years, but it is a possible scenario.

Ultimately NOBODY from a bank or credit card firm will EVER ask you to divulge card numbers, PINs or security codes over the phone.