There are many tools I use to make certain that a website is running properly and to make certain that search engines find what they need. One of these tools is the IIS Search Engine Optimization Toolkit:
The toolkit is a plugin for IIS 7 and will allow you to spider any site and find important things such as slow pages, broken links, pages with incorrect title information, etc.
Download the plugin and get detailed information on its use from here: IIS Search Engine Optimization Toolkit