Create one folder (mine is simply named "Reference").
Install Google Desktop (http://desktop.google.com/). It will index all of your files on your computer.
When you need a file use Google Desktop Search to find it.
If you have active projects and feel better creating individual folders, then create them as needed.
Move project folders to Reference folder when project is complete.