I have two PCs running Win XP connected to a wireless router.
What do I have to do to access either one from the other?

Set up simple file sharing on the PC that has the files you want to access.

Windows XP Simple File Sharing (http://www.practicallynetworked.com/sharing/xp/filesharing.htm)