Terminal displays directory of previous SSH location even when not running SSH

I am using the terminal app to ssh and when I do, it conveniently tells me (at the very top) what and where I am logged into for example:

user@computer:/home/user/directory/

and so forth. However, when I exit the ssh session and am sitting nicely at my local directory, it still tells me the directory path of the place I was previously logged in to.

Is there any way to have it tell me that information only when I am actually logged in to a remote machine? I have already gone to Terminal -> preferences -> profiles -> window and I only have "Dimensions" checked.