Harvesting returns a "Too many open files" error

12044
Reporter: jlegind
Assignee: kbraak
Type: Bug
Summary: Harvesting returns a "Too many open files" error
Priority: Major
Resolution: Duplicate
Status: Closed
Created: 2012-10-18 09:56:48.005
Updated: 2013-01-15 14:40:04.727
Resolved: 2012-11-22 15:48:03.262
        
Description: BioCASE resource: http://hit.gbif.org/console/list.html?datasourceId=2357

Similar prior issue:

http://code.google.com/p/gbif-indexingtoolkit/issues/detail?id=164&can=1&q=too%20many%20open%20files&colspec=ID%20Type%20Status%20Priority%20Milestone%20Owner%20Summary%20Blocked

From HIT log 2012-10-18:

Exception encountered:
java.io.FileOutputStream. open ( FileOutputStream.java: -2 )
java.io.FileOutputStream.  ( FileOutputStream.java: 179 )
java.io.FileOutputStream.  ( FileOutputStream.java: 70 )
org.gbif.harvest.writers.file.AbstractFileWriter. writeResponse ( AbstractFileWriter.java: 57 )
org.gbif.harvest.writers.RequestResponseWriterManager. writeResponse ( RequestResponseWriterManager.java: 45 )
org.gbif.harvest.util.biocase.BiocaseDataResponseHandler. handleResponse ( BiocaseDataResponseHandler.java: 51 )
org.gbif.harvest.util.biocase.BiocaseDataResponseHandler. handleResponse ( BiocaseDataResponseHandler.java: 18 )
org.apache.http.impl.client.AbstractHttpClient. execute ( AbstractHttpClient.java: 945 )
org.apache.http.impl.client.AbstractHttpClient. execute ( AbstractHttpClient.java: 919 )
org.apache.http.impl.client.AbstractHttpClient. execute ( AbstractHttpClient.java: 910 )
org.gbif.harvest.util.RequestUtils. executeGetRequestAndReturnDiagnostics ( RequestUtils.java: 288 )
org.gbif.harvest.biocase.BiocaseHarvester. fireSearch ( BiocaseHarvester.java: 290 )
org.gbif.harvest.biocase.BiocaseHarvester. search ( BiocaseHarvester.java: 780 )
org.gbif.harvest.biocase.BiocaseHarvester. search ( BiocaseHarvester.java: 664 )
sun.reflect.NativeMethodAccessorImpl. invoke0 ( NativeMethodAccessorImpl.java: -2 )
sun.reflect.NativeMethodAccessorImpl. invoke ( NativeMethodAccessorImpl.java: 39 )
sun.reflect.DelegatingMethodAccessorImpl. invoke ( DelegatingMethodAccessorImpl.java: 25 )
java.lang.reflect.Method. invoke ( Method.java: 597 )
org.apache.commons.beanutils.MethodUtils. invokeExactMethod ( MethodUtils.java: 404 )
org.gbif.harvest.scheduler.SimpleScheduler. triggerMethodInvocation ( SimpleScheduler.java: 1042 )
org.gbif.harvest.scheduler.SimpleScheduler. access$500 ( SimpleScheduler.java: 57 )
org.gbif.harvest.scheduler.SimpleScheduler$RunnableJob. run ( SimpleScheduler.java: 334 )
java.util.concurrent.ThreadPoolExecutor$Worker. runTask ( ThreadPoolExecutor.java: 886 )
java.util.concurrent.ThreadPoolExecutor$Worker. run ( ThreadPoolExecutor.java: 908 )
java.lang.Thread. run ( Thread.java: 662 )]]>
    

Author: kbraak@gbif.org
Comment: Will keep HIT-53 to deal with this work
Created: 2012-11-22 15:48:03.305
Updated: 2012-11-22 15:48:03.305