SOLR deep paging blows memory on species/search

17720
Reporter: trobertson
Type: Bug
Summary: SOLR deep paging blows memory on species/search
Priority: Major
Resolution: Fixed
Status: Closed
Created: 2015-07-23 17:18:45.851
Updated: 2015-07-23 19:19:30.905
Resolved: 2015-07-23 19:19:30.679
        
Description: The following 2 URLs will put SOLR into40GB of heap usage, due to the offset in the queries.

http://api.gbif.org/v1/species/search?limit=20&offset=20408380&q=*&hl=false&facetMultiselect=true&facet=THREAT&facet=RANK&facet=STATUS&facet=DATASET_KEY&facet=NOMENCLATURAL_STATUS&facet=ISSUE&facet=HIGHERTAXON_KEY&facet=IS_EXTINCT&facet=NAME_TYPE&facet=HABITAT

http://api.gbif.org/v1/species/search?limit=20&offset=20408120&q=*&hl=false&facetMultiselect=true&facet=THREAT&facet=RANK&facet=STATUS&facet=DATASET_KEY&facet=NOMENCLATURAL_STATUS&facet=ISSUE&facet=HIGHERTAXON_KEY&facet=IS_EXTINCT&facet=NAME_TYPE&facet=HABITAT
]]>
    

Author: trobertson@gbif.org
Created: 2015-07-23 19:19:30.866
Updated: 2015-07-23 19:19:30.866
        
Released in in 2.21 and deployed.

https://github.com/gbif/checklistbank/commit/0f33e2c82d5a06c6a0a995452b8a493be6834de2