Implement missing pieces of the Crawler

11800
Reporter: lfrancke
Assignee: lfrancke
Type: Improvement
Summary: Implement missing pieces of the Crawler
Priority: Blocker
Resolution: Fixed
Status: Closed
Created: 2012-08-31 11:49:47.333
Updated: 2013-12-17 15:46:37.824
Resolved: 2012-09-11 16:58:48.869
        
Description: Missing pieces:

* The actual Crawler tying the other pieces together
* Something that allows to report on the status of a running crawl
* Something that allows locking on URLs
* Something handling retries
* Something allowing for aborts on failures, user abort or exhausted retries]]>