Disconnect bluetooth speaker when on headphones

I have an external bluetooth speaker paired with my MacBook: If I plug in headphones, the speaker keeps on playing: And I have to manually disconnect the bluetooth speaker to get sound into headphones.

Is there a way to have this done automatically? At the moment it seems that OS X considers headphones and built-in speakers to be the same device. Is it possible to make it switch to headphones when I connect them?