Being incompetent should be a fireable offense, it generally is outside the the government; inside the government, those who can't do their job are usually promoted. Being in an affair makes you vulnerable to bribery and extortion, those usually aren't good things to be under when you are head of the chief spy agency for a country.