|
Home > Archive > IIS ASP > June 2004 > Crawl a site
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
|
|
|
| Is it possible to crawl a site using ASP & XML HTTP?
I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?
| |
| Eric Gibson 2004-06-28, 8:55 am |
| Dave wrote:
> Is it possible to crawl a site using ASP & XML HTTP?
>
> I know you can hit one link, but how can you go through each link in a
> page and validate that it returns 200?
Using PerlScript and the Robot module.
http://search.cpan.org/~awrigley/WW...ib/WWW/Robot.pm
Eric
|
|
|
|
|