Website URL Harvester – Multi-threaded Website Crawler

Description

Website URL Harvester is a simple multi-threaded website crawler application that allows a user to gather URL’s from a particular website. The list of URL’s can then be exported to a predefined location on the user’s computer.

The software works pretty well and can harvest thousands of internal URL’s from any website within a few minutes. The list of URL’s can then be used for various purposes such as screen capture, submission to directories, search engines, forums, etc.