To hold a grudge is to have and maintain a feeling of anger, bitterness, or resentment toward someone for something they did, especially a wrong that you think they committed against you.
The word grudge is typically used to refer to such a feeling when it has been held for a long period of time—often longer than is considered normal.