linux command line spider
Ever find yourself in the position where you have a page full of thumbnails that link to larger pictures, and you want to download the whole set in one go, but the directory is 403? Don't want to waste your time trying to download (and manage) annoying GUI-based spiders? Have a handy shell account laying around? Try this on for size:

wget -r -l 2 http://your.url.com/path/to/webpage/or/dir

of course you still might have some junk to clean up, but the most trivial of directory traversal will rectify that.

Enjoy!

- posted by frank crist @ 3:43 PM