Feature Requests

If a page is removed from a sitemap we should also set the status of that page to be removed and no longer display it in the results. We might want to notify the user that the page is no longer present.

Allow user to select the settings for auto indexing. Settings would include: * All pages * New pages only * Valid pages only * Missing Title * Missing Image * Missing Description