BAH!
You tell Amazon: Card Number + Billing Address
Amazon tells bank: I have this card number with this billing address.
Bank says: that billing address doesn't match, it might be a fake charge, I'm not approving it.
Seriously, I have had this happen to me before when I moved and updated my address with the bank but didn't update my billing address on the site I'm trying to buy from.