Icons make different software packages, folders, and file formats visually identifiable. You can change icons for shortcuts and folders in Windows 11. However, Windows doesn’t include any built-in options to customize icons for different file formats, such as PDF, PNG, JPG, MP3, TXT, etc.