Windows are slightly "transparent" in such a way I can see underlying windows show through slightly to the current window

I don't know how to explain it too well. Here are some places I see this happen: On the Minecraft main menu, I can see through to the desktop, While watching a youtube video (in full screen) I can see remnants of the previous page, etc.

How the heck do I fix this? It is really bugging me.