How to deter full screen mode moving window to a new display?

If I use that green button to maximize a window

it will enter full screen mode and move my window to a new "virtual" display to the right (those which you can switch by swiping with three fingers on the touchpad). If I click the green button again, it will leave fullscreen mode and move back to the initial display.

I'm wondering if there's a way to make the fullscreen application stay on the same display it used to be before maximizing (or even better to disable multiple displays per monitor at all).

The reason I would like to do that is that if I e.g. watch a video with the VLC media player I usually do so in fullscreen mode. Then I close the program with CMD+Q and it switches back to the first screen. After opening another video it will start playing the audio only but the video is being displayed on a different screen which is rather confusing, because I have three physical monitors attached and each of it got multiple virtual displays.