Paid Advertising is
ha.ckers sla.cking
How robots and spiders are causing issues, how to stop them. We can also talk about Completely Automated Public Turing Test To Tell Computers And Humans Apart - their use, their compliance issues, porn proxies, PWNtcha and other ways to defeat them. 
Go to Topic: PreviousNext
Go to: Forum ListMessage ListNew TopicSearchLog In
Posted by: jamuse
Date: May 10, 2007 03:16PM

Are there any freely available spiders that can compete with the likes of Appscan / Webinspect in terms of finding and parsing non standard links? I know burp has some javascript support, but it never seems to find the amount of web pages that the proprietary spiders find.

Options: ReplyQuote
Re: Spiders
Posted by: Anonymous User
Date: May 10, 2007 04:01PM

Hmmm, paros gets pretty close - but hasn't been supported for years...

...and went commercial some weeks ago.

Options: ReplyQuote
Re: Spiders
Posted by: nEUrOO
Date: May 25, 2007 02:51AM

Oh shit! It's too bad that it became comercial :/
If you are looking for tools, owasp has a good repository:

nEUrOO -- --

Options: ReplyQuote

Sorry, only registered users may post in this forum.