I feel your pain. But it is hard to deny that it can be rather effective in sending a message to those governments (think apartheid South Africa with a love for Rugby and Cricket, who were denied access to international events).
On the other hand, what is to be done when a player takes a political position (for example, speaks in support of an oppressive government or wears a symbol in support)?
It is sadly complicated…