Specifically I'm thinking about culture flipping planets, here. As it stands you get the "alarming influence" modifier while in the process of flipping a planet, but once it's flipped that goes away and, as often as not, relations increase. Subverting aplanet culturally is an act of aggression and really ought to be treated as such. Maybe not as an attack, but it certainly ought to have a lasting negative impact on relations.
Generally the AI seems all too willing to stand by and let you win, be it culturally or by research so long as you keep relations up or have an alliance. Generally it seems that the AI recognizes what you're doing (like the "We know what you're doing" modifier) but simply doesn't react strongly enough for it to matter. That's a shame, because honestly I've never seen an AI quite this adept at understanding what I'm doing. It's a pity to see it stand there smiling while I do it anyway.
I suppose I should note here that my experience is based on playing on tough.