It is not possible to decline an event invite post acceptance of the same. You will be marked “No Show” and will be considered by the company during their next drives if any.
Please note that the companies can see how many times you have been marked as a “No Show” in the past across all the companies. If they see more than 3 No Shows, they may not shortlist you thinking that you are a non serious candidate.