So I came across this recently and thought to share it with you guys.
First of all, exit steam completely. If you’ve closed it, check if it’s in the system tray and if it is, exit from there as well. Now, fire up Windows Explorer and go to where steam is installed on your computer. In my case, it was in the default installation directory (C:\Program Files (x86)\Steam).