Download of a large download failed

18860
Reporter: mblissett
Type: Bug
Summary: Download of a large download failed
Priority: Major
Resolution: Fixed
Status: Resolved
Created: 2016-12-07 23:49:28.864
Updated: 2017-01-27 14:33:25.146
Resolved: 2017-01-27 14:33:24.977
        
Description: wget http://api.gbif.org/v1/occurrence/download/request/0039949-160910150852091.zip

failed after 35GB on ftp-vh, then after 7GB on mblissett-linux.

Reading/copying the file over NFS was successful on prodapps2-vh and mblissett-linux.

The first place I'd look is the new Varnish, the old Varnish still exists and could be used to test.]]>
    

Author: mblissett
Created: 2016-12-08 17:31:40.898
Updated: 2016-12-08 17:31:40.898
        
The occurrence-ws should add a Content-Length header to downloads, to aid resuming interrupted downloads.

    

Author: mblissett
Comment: This was caused by a change in how Varnish handles large objects. A different return code was required to prevent Varnish trying to keep the object in RAM.
Created: 2017-01-27 14:33:25.085
Updated: 2017-01-27 14:33:25.085