Some reasons why a valid credit card is rejected at membership checkout or membership renewal

We occasionally hear that a customer cannot complete checkout on their site using a valid credit card. The card is declined at checkout, or the card is declined when a recurring payment is processed. In some cases, the site owner can process the card directly through the virtual terminal, so its clear the card is valid. So why is the payment gateway rejecting the card?