If you need to find the broken links on your site and, perhaps, want to restrict spidering to a specific directory, domain or anything you can describe with a regular expression you need Site Spider. The author notes “Because this is a client-side spider, it uses your own authentication to access pages. Thus it can go wherever you have access to go. This plugin does not log any data or ‘phone home’ in any way. It is completely open source.” Site Spider gets a user rating of 3 out of 5, but looking through the comments, it appears that many users are, shall we say, clue deficient.