Control Panel -> Appearance and Personalization -> Folder Options. Zakładka View i odznacz Hide extensions for known file types.
