Improve Solr import handler performance

10457
Reporter: mdoering
Assignee: fmendez
Type: Improvement
Summary: Improve Solr import handler performance
Description: Try to use the api model objects and use the mybatis layer directly
Priority: Minor
Resolution: Incomplete
Status: Closed
Created: 2011-11-25 12:42:10.666
Updated: 2013-12-09 14:01:18.296
Resolved: 2012-02-06 12:41:31.005

Author: fmendez@gbif.org
Comment: A new indexer was implemented using the MyBatis layer, the performance is much worst than the Solr DIH. At this moment using: 10 threads and page size of 100,the whole process is taking more than 90 hours to complete. We should start thinking in a new strategy.
Created: 2012-02-06 12:41:31.067
Updated: 2012-02-06 12:41:31.067