Help Debug Robot Spider -

I am using a program in vb.net originally in c# which I converted to vb.net. I have converted this from a project to a website. The goal is to integrate this with my existing website application in vb.net. This spider is working although it has some issues and I have fixed some of them including relative urls, however it is not doing what I need done. The idea is that the spider provides a list of valid urls found by starting at the home page and checking each href found for other pages. The final list will remove all duplicates and consist solely of valid existing pages that have been tested for their existance. There is a problem with single quotes right now, and I could not get it to remove them. This website consists of 2 pages, one class page and the other [login to view URL] The .dlls and .pdb files are in the bin folder. The project assists me with my add a link page script. I am giving the browser the opportunity to enter into a textbox a valid url page on which they have placed the linking code. The idea is that they get ONE chance to ever a valid page, and the page they enter into the textbox will be cross checked against the complete LIST of valid urls aftering spidering their website 3 levels deep. If a match is not found, then there is a dropdown selector which will appear on the page where they input their url. This selctor will contain all the valid urls, and they will be required to place the linking code onto one of these pages, and select that page. Here's a sample: [login to view URL] That selector is currently in a hidden iframce right between the save button at the bottom of the page and the reciprocal link textbox. The best way to get acclimated with this is to log onto my machine via "GOTOMYPC" and it's easy to do this. I just send an email to you and you can login to my machine and have access to my mouse and there is a conversation box. This shouldn't take more than an hour or two to get through. I can post the code for you to review. ## Deliverables It's important that you know queueing.