How to remove Preview.app on-screen navigation toolbar?

When I open a picture in fullscreen, it has an overlay like this:

Is there a way to permanently disable it?