VLC player does not remember last played position

I have been using MplayerX and recently thought of trying out VLC for watching movies. I noticed that the VLC player does not remember the last played position of the video. If I quit VLC and play the same video again, it plays it from the beginning.

Is this feature not provided by VLC? If not, is there any workaround to get this working?