Improve occurrence downloads for "small" amounts of records

13181
Reporter: fmendez
Assignee: fmendez
Type: Improvement
Summary: Improve occurrence downloads for "small" amounts of records
Description: Occurrence download could create a huge hadoop-cluster load when several downloads are being running in parallel. One option to improve the download process could be changing the current workflow for downloads with small amount of records; for example by using the Solr index to retrieve the documents keys and then get those documents using the occurrence key from HBase; other options should be explored to evaluate the feasibility of this issue.
Priority: Critical
Resolution: Fixed
Status: Closed
Created: 2013-05-23 11:05:18.623
Updated: 2013-12-17 15:17:13.26
Resolved: 2013-07-24 15:32:57.66