Upon installation, Sumatra should register af default preview handler for .pdf
This way, sumatra will deliver the preview in Windows Explorer Preview Pane.
Currently, the following alternatives exist:
http://www.windows8pdf.com/pdfpreviewer.html
http://timheuer.com/blog/archive/2008/05/09/foxit-pdf-preview-handler.aspx
Also, this resource could be helpful.
https://msdn.microsoft.com/en-us/library/windows/desktop/cc144139(v=vs.85).aspx
Agree this is something that seems inconsequential but is actually really useful from a user perspective. Especially since most users have tons of documents all in one folder.
I concur. I'd prefer to use Sumatra, but I'm currently installing Acrobat Reader because I cannot do without the preview (Windows 10 here too).
We already do that. When installing, click "Options" and select "Let Windows show previews of PDF documents"

Great, thanks. Should be default IMO, at least when the user has the preview pane enabled in Windows Explorer.
I was glad to find this answer as I could not discover how to change this setting using SumatraPDF's Options or Advanced Options (I also initially didn't understand that Windows has _TWO_ ways of associating a file type with a program: _Default Program_ as well as _Default Preview Handler_, this being the latter).
In my case I already had the latest version of SumatraPDF installed, but was able to simply execute SumatraPDF-3.1.2-64-install.exe and have it reinstall itself, allowing me to click the Options button as illustrated above and select _Let Windows show previews of PDF documents_. This disabled Acrobat as my previewer and enabled SumatraPDF, apparently by making Registry modifications.
This does not work for me.
@jpmaterial
most users can get this to work by uninstall and reinstall with options selected, however you MUST use the correct version e.g. 64bit install on 64bit windows or 32bit install on 32bit windows (most common reason for failure) ALSO will depend on User Access Control, I have no problem as I am an elevated user, some users need to either run as administrator or not for windows to allow the changes.
This did not work for me. I am local admin, I'm using 64 bit Windows and SumatraPDF and I just un- and reinstalled. Still no preview.
@jpmaterial
I am surprised that after so many attempts you have not got it to work, It is possible that your acrobat installation has had an affect that others have not had. can you confirm the program files folder name is NOT (x86) and from properties > details of the PdfPreview.dll file in that folder what file version you have and from the general tab the exact Size e.g. something like 241 KB (247,296 bytes)
C:\Program Files\SumatraPDF\PdfPreview.dll has 230 KB (235520 bytes). The file version is 3.1.2.0.
Ok that seems to be all present and correct, so I just reinstalled exactly the same version as administrator and can NOT see a pdf preview (I could before). That is because on uninstall/reinstall windows resets its default viewer back to edge so now my icons are a small blue e with grey pdf. My first task is to get windows 10 to stop interfering with my choice. If I try any of the old methods like run SumatraPDF as administrator or use the internal settings to try to get Sumatra as default handler they don't work as Win10 will keep insisting Edge is king of the viewers. So logged in as admin I have to right click a pdf and using the properties option go to general tab where it says "opens with" then click on change button and select SumatraPDF . NOW all my pdf icons change from blue/grey to yellow/black and If preview pane is active I can see the pdf preview again and if there is more than one page scroll though the pages (there are no other controls visible, if there are more controls such as zoom then another previewer must be active).
I get the preview in Windows Explorer, my problem is the preview in Outlook.
Ok now I understand preview is for system thus 64bit if outlook is 32 bit then it will not work so check if outlook is 32 bit.
IF so then you can only install 32 bit for outlook or 64bit for windows or upgrade outlook to 64bit
We already do that. When installing, click "Options" and select "Let Windows show previews of PDF documents"
This is when I realized that using auto installers like Ninite is sometimes counter-productive.
The options are off by default, so I had to look this up and reinstall Sumatra manually.
Most helpful comment
We already do that. When installing, click "Options" and select "Let Windows show previews of PDF documents"