1. You may look for them in the Windows Explorer folders. 
For example, in Netscape:
 
You may pull down the Edit menu above and choose Select All, and delte these Cache files.
2. You may search for them them using the Tools Find utility:
 
Then search for .tmp files, for example:
 
The files may be clicked on and deleted.
When in doubt, do not delete!