Find a better way to produce a single file as download result

11208
Reporter: omeyn
Assignee: omeyn
Type: Task
Summary: Find a better way to produce a single file as download result
Description: The current method uses an unholy group by to force a single reducer which produces a single file.  It's ugly and unmaintainable - find a better way, maybe with HDFSMerger from hadoop.
Priority: Major
Resolution: Fixed
Status: Closed
Created: 2012-05-18 16:34:11.746
Updated: 2013-12-17 15:17:05.769
Resolved: 2012-05-24 11:43:02.882

Author: omeyn@gbif.org
Comment: Fixed by using Hadoop's FileUtil.copyMerge. Discards the whole concatenate step.
Created: 2012-05-24 11:43:02.907
Updated: 2012-05-24 11:43:02.907