Processor zookeeper counts are mismatched after crawl is finished

12978
Reporter: omeyn
Assignee: omeyn
Type: Bug
Summary: Processor zookeeper counts are mismatched after crawl is finished
Priority: Major
Resolution: Fixed
Status: Closed
Created: 2013-03-08 14:31:47.513
Updated: 2013-12-17 15:16:47.779
Resolved: 2013-04-29 14:10:50.364
        
Description: Like:

{
"datasetUuid": "c585e6fb-fd76-426e-ae01-a32dc9de5689",
"crawlJob": {
"datasetUuid": "c585e6fb-fd76-426e-ae01-a32dc9de5689",
"endpointType": "DWC_ARCHIVE_OCCURRENCE",
"targetUrl": "http://gbif.biodiversityireland.ie/AtlasOfMammals.zip",
"attempt": 5,
"properties": {}
},
"startedCrawling": "2013-03-08T12:42:25.491+0000",
"finishedCrawling": "2013-03-08T12:42:26.578+0000",
"finishReason": "NORMAL",
"pagesCrawled": 1,
"pagesFragmentedSuccessful": 1,
"pagesFragmentedError": 0,
"fragmentsEmitted": 10546,
"fragmentsReceived": 10505,
"rawOccurrencesPersistedNew": 10496,
"rawOccurrencesPersistedUpdated": 0,
"rawOccurrencesPersistedUnchanged": 9,
"rawOccurrencesPersistedError": 0,
"fragmentsProcessed": 10502,
"verbatimOccurrencesPersistedSuccessful": 10537,
"verbatimOccurrencesPersistedError": 0,
"interpretedOccurrencesPersistedSuccessful": 10537,
"interpretedOccurrencesPersistedError": 0
}
]]>
    

Author: omeyn@gbif.org
Comment: appears solved in the meantime
Created: 2013-04-29 14:10:50.399
Updated: 2013-04-29 14:10:50.399